-- Logs begin at Mon 2022-05-09 17:33:35 UTC, end at Mon 2022-05-09 18:49:41 UTC. -- May 09 18:20:47.029184 dv-cinder-841125-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 18:20:47.037736 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 18:20:47 2022] *** May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: nodename: dv-cinder-841125-3-iscsi May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: machine: x86_64 May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: clock source: unix May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: pcre jit disabled May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: detected number of CPU cores: 4 May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: current working directory: / May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: detected binary path: /usr/bin/uwsgi-core May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: your processes number limit is 47680 May 09 18:20:47.041293 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: your memory page size is 4096 bytes May 09 18:20:47.042001 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: detected max file descriptor number: 2048 May 09 18:20:47.042001 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: lock engine: pthread robust mutexes May 09 18:20:47.042001 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: thunder lock: enabled May 09 18:20:47.042001 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 18:20:47.042001 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 18:20:47.087389 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: Python main interpreter initialized at 0x564d7d6029c0 May 09 18:20:47.087389 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: python threads support enabled May 09 18:20:47.087389 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: your server socket listen backlog is limited to 100 connections May 09 18:20:47.087389 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: your mercy for graceful operations on workers is 90 seconds May 09 18:20:47.087906 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: mapped 403077 bytes (393 KB) for 2 cores May 09 18:20:47.087906 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: *** Operational MODE: preforking *** May 09 18:20:47.088076 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: *** uWSGI is running in multiple interpreter mode *** May 09 18:20:47.088076 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: spawned uWSGI master process (pid: 102548) May 09 18:20:47.088287 dv-cinder-841125-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 18:20:47.092224 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: spawned uWSGI worker 1 (pid: 102549, cores: 1) May 09 18:20:47.092224 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: spawned uWSGI worker 2 (pid: 102550, cores: 1) May 09 18:20:47.092224 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 18:20:48.275091 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:20:48.287108 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:20:49.010955 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:20:49.010955 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: from cryptography.utils import int_from_bytes May 09 18:20:49.011299 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:20:49.011299 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: from cryptography.utils import int_from_bytes May 09 18:20:49.014316 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:20:49.014316 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: from cryptography.utils import int_from_bytes May 09 18:20:49.014642 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:20:49.014642 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: from cryptography.utils import int_from_bytes May 09 18:20:51.586627 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:20:51.587228 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:20:51.587425 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:20:51.587532 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:20:51.587876 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:20:51.587955 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:20:51.588042 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:20:51.588221 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:20:51.588408 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.588592 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:20:51.588739 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.588861 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:20:51.589063 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.589257 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.589389 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.589595 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.589720 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.589925 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.590032 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.590254 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.590351 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.590586 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.590683 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.590904 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.590999 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.591251 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.591357 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.591570 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.591668 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.591896 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-3-iscsi {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.591990 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.592162 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.592252 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.592485 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.592579 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.592815 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.592908 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-3-iscsi {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.593138 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.593237 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.593442 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.593533 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.593758 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.593842 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.594062 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.594191 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.594475 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.594603 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.594722 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.595699 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.595837 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.595959 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596063 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596166 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596252 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596331 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596455 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596536 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596621 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596708 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596787 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.596929 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.597110 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.597196 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.597432 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.597576 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.597764 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.597850 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.598085 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.598222 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-3-iscsi {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.598447 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.598533 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.598769 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.598868 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.599104 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.599217 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-3-iscsi {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.599509 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.599595 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.599832 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.599971 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.600154 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.600253 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.600476 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.600569 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.600805 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.600892 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.601118 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.601204 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.601450 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.601540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.601774 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.601860 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.602096 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.602229 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.602418 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.602506 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.602722 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.602809 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.603034 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.603131 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.603371 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.603470 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.603694 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.603796 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604003 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604102 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604310 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604404 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604563 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604701 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604872 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.604969 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.605196 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.605289 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.605495 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.605580 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.605813 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.605904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.606074 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.606203 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.606328 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.606462 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.606648 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.606793 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.606969 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.607057 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.607302 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.607423 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.607616 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.607704 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.607926 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.608012 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.608237 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.608333 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.608546 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.608634 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.608855 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.608942 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.609166 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.609258 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.609479 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.609570 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.609796 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.609883 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.610112 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.610200 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.610429 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.610515 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.610736 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.610820 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.611058 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.611218 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.611414 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.611517 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.611730 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.611815 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.612043 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.612130 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.612385 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.612478 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.612693 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.612784 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.613003 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.613094 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.613325 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.613411 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.613647 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.613748 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.613972 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.614058 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.614298 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.614427 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.614609 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.614708 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.614929 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.615016 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.615267 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.615359 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.615576 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.615671 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.615828 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.615915 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.616132 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.616218 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.616443 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.616538 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.616760 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.616851 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.617066 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.617156 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.617374 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.617463 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.617682 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.617768 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.617984 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.618069 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.618293 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.618386 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.618603 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.618697 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.618907 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.618991 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.619232 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.619319 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.619552 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.619646 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.619854 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.619939 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.620162 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.620249 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.620469 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.620554 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.620777 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.620862 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.621093 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.621179 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.621405 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.621786 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.621970 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.622065 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.622277 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.622373 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.622584 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.622684 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.622892 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.622986 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.623235 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.623336 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.623546 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.623638 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.623856 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.623943 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.624178 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.624265 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.624485 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.624606 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.624793 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.624927 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.625113 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.625200 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.625421 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.625514 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.625728 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.625822 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.626049 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.626142 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.626350 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.626435 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.626657 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.626752 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.626974 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.627061 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.627302 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.627389 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.627610 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.627708 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.627917 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.628003 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.628222 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.628315 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.628525 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.628620 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.628832 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.628917 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.629136 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.629222 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.629443 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.629529 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.630295 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.630388 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.630607 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.630694 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.630918 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.631006 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.631245 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.631346 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.631557 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.631661 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.631868 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.631958 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.632189 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.632276 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.632500 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.632592 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.632817 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.632904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.633143 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:20:51.633230 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.633473 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.633632 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.633809 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.633897 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.634141 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.634228 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.634456 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.634602 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.634768 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.634863 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.635084 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.635222 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.635436 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.635543 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.635750 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.635837 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.636066 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.636153 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.636380 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.636475 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.636699 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.636789 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.637018 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.637112 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.637339 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.637426 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.637654 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.637749 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.637971 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.638060 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.638292 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.638379 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.638604 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.638690 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.638923 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.639016 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.640227 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.640374 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.640374 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.640638 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.640638 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.640921 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641082 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641082 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641082 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641430 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641520 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641607 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641779 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.641878 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.642089 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.642178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.642403 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.642498 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.642728 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.642816 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.643061 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.643156 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.643401 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.643498 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.643724 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.643811 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.644040 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.644126 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.644355 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.644451 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.644670 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.644768 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.644985 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.645072 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.645352 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.645990 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.646208 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.646293 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.646525 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.646609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.646842 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.646930 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.647159 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.647266 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.647498 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.647584 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.647819 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.647907 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.648134 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.648230 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.648450 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.648536 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.648759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.648846 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.649066 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.649153 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.649379 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.649465 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.649692 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.649781 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.650000 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.650087 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.650322 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.650406 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.650643 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.650729 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.650950 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.651036 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.651283 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.651385 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.651601 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.651694 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.651913 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.651997 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.652224 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.652322 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.652534 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.652626 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.652841 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.652935 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.653156 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.653259 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.653469 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.653557 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.653776 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.653865 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.654101 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.654196 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.654415 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.654500 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.654723 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.654809 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.655032 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.655118 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.655368 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.655453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.655675 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.655772 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.655984 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.656070 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.656298 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.656384 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.656612 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.656698 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.656923 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.657010 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.657235 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.657321 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.657552 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.657643 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.657863 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.657951 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.658176 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.658260 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.658492 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.658587 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.658811 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.658897 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.659125 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.659238 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.659466 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.659563 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.659796 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.659881 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.660112 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.660198 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.660418 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.660512 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.660731 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.660817 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.661063 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.661148 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.661372 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.661466 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.661678 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.661764 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.661990 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.662076 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.662295 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.662383 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.662601 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.662686 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.662906 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.662994 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.663230 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.663322 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.663542 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.663631 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.663867 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.663953 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.664179 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.664265 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.664485 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.664576 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.664793 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.664934 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.665100 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.665186 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.665410 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.665495 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.665720 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.665816 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.666049 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.666136 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.666365 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.666451 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.666678 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.666778 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.666988 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.667074 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.667325 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.667415 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.667642 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.667749 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.667955 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.668050 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.668270 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.668356 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.668582 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.668677 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.668897 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.668984 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.669221 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.669308 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.669542 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.669637 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.669866 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.669953 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.670179 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.670268 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.670495 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.670585 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.670805 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.670891 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.671120 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.671224 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.671451 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.671539 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.671767 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.671852 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.672094 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.672188 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.672412 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.672500 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.672736 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.672820 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.673051 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.673135 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.673365 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.673457 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.673675 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.673766 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.673984 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.674079 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.674300 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.674387 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.674614 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.674707 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.674929 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.675024 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.675270 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.675362 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.675587 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.675672 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.675909 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.676007 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.676220 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.676320 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.676572 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.676663 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.676892 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.676987 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.677213 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.677301 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.677538 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.677636 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.677859 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.677946 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.678185 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.678278 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.678503 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.678591 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.678831 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.678918 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.679145 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.679246 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.679495 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.679581 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.679807 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.679895 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.680119 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.680206 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.680433 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.680532 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.680741 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.680829 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.681047 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.681141 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.681361 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.681469 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.681678 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.681772 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.681992 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.682078 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.682307 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.682438 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.682612 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.682707 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.682925 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.683010 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.683257 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.683360 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.683567 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.683653 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.683872 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.683958 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.684188 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.684282 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.684503 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.684591 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.684815 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.684908 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.685137 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.685224 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.685449 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.685536 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.685756 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.685843 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.686063 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.686150 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.686382 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.686476 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.686691 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.686777 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.686998 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.687088 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.687329 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.687474 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.687641 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.687729 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.687963 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.688056 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.688274 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.688360 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.688579 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.688670 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.688897 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.688985 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.689209 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.689292 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.689520 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.689615 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.689832 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.689917 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.690141 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.690238 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.690450 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.690549 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.690772 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.690860 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.691086 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.691221 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.691421 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.691520 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.691736 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.691822 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.692048 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.692657 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.692895 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.692994 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.693208 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.693294 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.693532 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.693618 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.693842 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.693930 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.694155 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.694248 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.694466 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.694615 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.694772 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.694868 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.695083 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.695232 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.695434 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.695578 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.695764 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.696001 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.696099 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.696335 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.696439 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.696651 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.696756 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.696970 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.697063 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.697288 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.697379 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.697650 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.697743 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.697933 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.698168 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.698262 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.698507 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.698611 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.698830 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.698933 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.699156 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.699347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.699500 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.699587 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.699812 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.699905 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.700123 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.700215 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.700429 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.700530 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.700737 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.700838 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.701041 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.701144 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.701352 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.701453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.701655 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.701761 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.701962 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.702054 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.702264 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.702357 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.702569 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.702671 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.702884 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.702984 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.703204 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.703294 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.703523 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.703631 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.703827 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.703920 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.704134 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.704234 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.704444 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.704536 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.704748 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.704840 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.705053 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.705154 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.705361 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.705473 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.705680 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.705774 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.705989 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.706081 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.706318 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.706411 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.706636 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.706728 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.706949 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.707050 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.707291 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.707385 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.707597 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.707741 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.708512 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.708618 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.708824 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.708918 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.709133 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.709234 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.709443 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.709551 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.709757 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.709850 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.710070 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.710162 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.710376 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.710478 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.710691 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.710785 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.711006 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.711100 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.711341 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.711448 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.711652 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.711750 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.711955 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.712047 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.712269 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.712365 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.712577 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.712664 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.712942 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.713039 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.713205 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.713296 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.713510 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.713599 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.713790 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.713892 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.714101 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.714194 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.714410 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.714504 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.714713 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.714815 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.715023 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.715116 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.715351 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.715461 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.715661 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.715767 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.715963 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.716061 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.716266 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.716364 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.716570 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.716677 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.716877 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.716973 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.717186 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.717283 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.717489 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.717596 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.717808 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.717911 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.718117 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.718214 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.718422 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.718517 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.718722 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.718818 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.719031 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.719128 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.719358 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.719458 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.719665 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.719754 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.719974 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.720062 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.720297 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.720388 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.720604 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.720692 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.720906 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.720995 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.721218 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.721316 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.721522 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.721611 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.721826 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.721924 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.722131 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.722220 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.722440 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.722530 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.722745 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.722844 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.723048 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.723145 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.723392 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.723502 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.723697 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.723802 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.724002 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.724093 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.724323 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.724412 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.724632 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.724731 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.724939 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.725031 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.725242 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.725331 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.725545 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.725635 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.725853 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.725943 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.726161 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.726251 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.726491 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.726585 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.726802 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.726893 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.727113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.727253 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.727452 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.727543 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.727764 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.727853 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.728077 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.728174 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.728393 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.728525 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.728698 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.728828 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.729014 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.729144 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.729328 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.729458 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.729646 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.729775 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.729948 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.730086 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.730250 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.730388 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.730570 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.730701 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.730882 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.731025 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.731208 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.731342 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.731535 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.731679 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.731881 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.732021 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.732157 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.732284 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.732460 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.732597 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.732771 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.732912 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.733160 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.733300 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.733426 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.733560 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.733696 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.733823 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.733991 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.734122 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.734302 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.734432 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.734616 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.734747 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.734929 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.735060 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.735280 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.735412 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.735598 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.735735 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.735903 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.736034 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.736213 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.736342 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.736523 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.736657 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.736829 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.736959 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.737145 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.737283 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.737454 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.737583 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.737760 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.737890 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.738067 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.738211 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.738371 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.738506 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.738681 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.738810 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.738989 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.739652 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.739850 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.739980 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.740171 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.740301 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.740498 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.740638 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.740817 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.740948 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.741132 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.741262 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.741469 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.741598 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.741745 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.741874 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.742061 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.742191 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.742367 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.742497 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.742781 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.742911 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.743094 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.743260 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.743464 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.743595 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.743720 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.743852 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.744019 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.744148 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.744323 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.744455 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.744636 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.744766 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.744959 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.745098 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.745264 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.745395 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.745566 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.745696 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.745870 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.746014 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.746192 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.746322 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.746746 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.746877 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.747070 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.747270 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.747475 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.747615 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.747788 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.747922 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.748100 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.748238 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.748413 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.748544 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.748744 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.748873 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.749056 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.749186 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.749385 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.749514 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.749733 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.749855 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.750057 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.750188 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.750364 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.750486 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.750679 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.750818 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.750990 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.751128 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.751337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.751480 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.751662 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.751803 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.751974 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.752104 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.752304 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.752434 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.752586 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.752717 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.752909 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.753041 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.753233 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.753364 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.753573 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.753703 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.753856 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.753996 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.754261 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.754390 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.754604 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.755268 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.755455 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.755604 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.755779 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.755911 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.756108 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.756237 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.756412 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.756550 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.756717 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.756847 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.757030 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.757162 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.757339 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.757483 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.757645 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.757785 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.757967 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.758098 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.758275 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.758407 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.758589 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.758720 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.758899 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.759038 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.759232 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.759364 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.759545 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.759688 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.759852 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.759975 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.760174 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.760305 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.760480 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.760611 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.760819 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.760950 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.761133 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.761265 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.761446 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.761575 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.761756 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.761896 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.762066 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.762207 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.762390 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.762528 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.762698 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.762836 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.763003 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.763132 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.763330 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.763473 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.763624 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.763831 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.763962 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.764089 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.764264 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.764396 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.764586 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.764726 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.764917 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.765046 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.765233 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.765373 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.765544 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.765675 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.765856 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.765986 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.766192 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.766321 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.766508 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.766638 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.766823 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.766951 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.767147 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.767320 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.767466 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.767603 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.767767 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.767897 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.768078 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.768208 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.768386 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.768519 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.768691 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.768821 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.768995 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.769138 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.769305 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.769435 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.769612 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.769757 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.769914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.770053 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.770236 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.770366 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.770561 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.770704 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.770866 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.771007 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.771218 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.771353 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.771521 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.771652 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.771826 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.771973 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.772129 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.772258 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.772434 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.772563 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.772765 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.772896 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.773068 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.773196 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.773395 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.773533 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.773709 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.773852 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.774041 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.774169 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.774319 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.774448 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.774630 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.774762 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.774951 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.775087 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.775291 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.775434 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.775611 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.775743 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.775928 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.776058 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.776244 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.776382 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.776560 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.776689 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.776876 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.777006 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.777192 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.777335 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.777502 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.777643 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.777820 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.777951 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.778135 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.778274 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.778452 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.778583 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.778771 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.778976 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.779107 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.779344 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.779477 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.779671 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.779809 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.779991 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.780132 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.780309 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.780439 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.780627 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.780756 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.780945 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.781166 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.781323 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.781507 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.781640 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.781831 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.781960 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.782163 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.782292 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.782459 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.782590 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.782783 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.782921 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.783104 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.783296 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.783449 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.783579 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.783773 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.783916 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.784124 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.784260 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.784386 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.784510 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.784703 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.784843 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.785042 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.785172 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.785366 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.785496 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.785679 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.785811 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.786024 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.786154 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.786342 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.786472 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.786662 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.786791 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.786976 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.787104 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.787314 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.787447 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.787635 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.787765 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.787935 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.788066 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.788249 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.788398 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.788563 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.788694 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.788879 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.789010 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.789194 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.789338 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.789521 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.789649 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.789842 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.789979 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.790163 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.790287 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.790479 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.790609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.790795 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.790930 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.791110 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.791277 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.791456 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.791657 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.791796 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.791976 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.792116 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.792323 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.792460 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.792651 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.792781 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.792979 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.793120 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.793297 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.793428 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.793616 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.793875 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.794015 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.794230 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.794369 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.794532 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.794664 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.794843 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.794982 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.795156 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.795306 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.795487 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.795618 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.795810 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.795950 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.796122 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.796254 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.796430 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.796568 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.796746 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.796876 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.797056 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.797185 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.797381 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.797589 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.797730 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.797931 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.798061 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.798247 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.798377 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.798575 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.798718 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.798901 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.799038 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.799243 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.799378 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.799560 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.799787 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.799927 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.800137 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.800266 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.800460 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.800605 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.800782 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.800910 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.801096 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.801226 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.801404 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.802028 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.802225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.802363 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.802537 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.802674 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.802849 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.802988 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.803158 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.803305 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.803494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.803622 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.803803 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.803950 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.804116 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.804245 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.804451 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.804579 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.804714 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.804842 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.805011 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.805143 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.805325 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.805455 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.805633 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.805764 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.805938 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.806068 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.806245 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.806375 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.806552 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.806683 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.806862 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.806991 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.807167 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.807351 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.807492 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.807621 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.807791 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.807922 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.808104 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.808243 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.808407 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.808535 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.808713 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.808850 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.809031 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.809174 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.809341 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.809472 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.809657 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.809787 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.809961 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.810100 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.810279 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.810410 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.810589 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.810719 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.810906 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.811046 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.811237 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.811380 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.811555 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.811685 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.811890 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.812018 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.812200 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.812330 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.812528 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.812730 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.812875 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.813067 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.813198 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.813388 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.813519 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.813722 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.813865 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.814055 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.814193 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.814362 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.814565 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.814695 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.814948 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.815208 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.815342 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.815467 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.815595 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.815742 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.815900 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.816037 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.816213 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.816368 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.816525 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.816686 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.816838 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.817001 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.817174 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.817867 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.818060 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.818201 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.818373 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.818504 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.818686 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.818825 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.818998 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.819130 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.819333 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.819505 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.819703 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.819839 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.819976 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.820107 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.820285 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.820417 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.820606 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.820736 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.820925 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.821075 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.821248 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.821414 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.821544 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.821680 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.821836 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.821970 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.822541 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.822676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.822803 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.822940 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.823069 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.823228 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.823358 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.823486 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.823610 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.823756 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.823892 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.824027 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.824155 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.824281 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.824406 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.824557 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.824754 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.824885 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.825010 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.825146 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.825321 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.825454 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.825635 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.825766 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.825959 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.826093 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.826270 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.826412 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.826585 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.826714 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.826917 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.827050 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.827252 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.827386 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.827586 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.827728 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.827929 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.828073 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.828260 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.828390 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.828588 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.828717 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.828894 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.829033 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.829204 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.829336 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.829516 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.829647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.829826 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.829967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.830146 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.830278 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.830458 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.830588 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.830762 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.830893 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.831066 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.831270 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.831402 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.831528 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.831678 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.831841 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.831969 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.832095 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.832279 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.832411 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.832584 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.832717 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.832930 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.833060 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.833235 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.833375 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.833540 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.833671 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.833843 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.833973 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.834147 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.834292 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.834450 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.834596 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.834770 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.834964 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.835101 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.835260 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.835390 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.835516 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.835643 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.835768 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.835951 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.836091 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.836256 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.836398 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.836562 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.836734 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.836869 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.837007 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.837157 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.837288 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.837469 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.837599 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.837779 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.837918 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.838090 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.838230 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.838399 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.838529 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.838709 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.838841 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.839028 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.839156 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.839379 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.839551 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.839694 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.839824 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.839992 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.840122 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.840327 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.840471 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.840641 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.840778 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.840953 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.841081 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.841266 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.841471 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.841609 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.841743 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.841870 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.841996 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.842174 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.842323 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.842503 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.842642 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.842825 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.842955 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.843131 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.843295 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.843478 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.843606 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.843795 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.843932 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.844110 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.844240 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.844426 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.844556 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.844740 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.844877 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.845100 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.845231 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.845365 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.845491 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.845667 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.845797 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.845985 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.846119 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.846297 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.846441 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.846611 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.846752 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.846928 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.847056 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.847262 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.847405 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.847592 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.847731 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.847907 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.848047 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.848229 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.848378 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.848572 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.848712 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.848893 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.849023 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.849216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.849347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.849540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.849670 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.849874 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.850004 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.850191 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.850321 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.850504 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.850635 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.850809 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.850932 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.851056 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:20:51.851206 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.851514 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.851867 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.852204 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.852525 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.852846 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.853158 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:20:51.853408 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:20:51.874634 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:51.876562 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:51.939674 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.context [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6582a570-2abd-4bbd-b400-f90edc06f4a6(cell1) {{(pid=102550) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:20:51.943549 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.context [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6582a570-2abd-4bbd-b400-f90edc06f4a6(cell1) {{(pid=102549) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:20:51.944655 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:20:51.946255 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:20:51.947060 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:20:51.947894 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:20:51.949054 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:20:51.949466 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:20:51.950269 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:20:51.952269 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:20:51.960584 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:51.966200 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:51.969763 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:51.975058 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:52.124019 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:52.133252 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:20:52.468592 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:20:52.469459 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:20:52.476011 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:20:52.476850 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:20:52.820435 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:20:52.824338 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:20:52.826586 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:20:52.830401 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-d7e6a904-86e1-4ad8-b2a9-6363b617aec9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:20:52.833202 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d7d6029c0 pid: 102549 (default app) May 09 18:20:52.835297 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:20:52.836475 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 May 09 18:20:52.836878 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Mon May 9 18:20:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:20:52.837026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d7d6029c0 pid: 102550 (default app) May 09 18:22:09.962715 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:09.963795 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 09 18:22:09.964193 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:10.393040 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-4d109ac8-0660-4203-ac06-f5a6a1b6e5ca admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:10.423127 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-4d109ac8-0660-4203-ac06-f5a6a1b6e5ca admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451939 May 09 18:22:10.424562 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Mon May 9 18:22:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:22:12.698569 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:12.699625 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-7f045e33-4f2b-4b35-b29b-eae8dfdf6945 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 09 18:22:12.700037 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:12.764066 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-d625fdf7-c8fd-4534-9f1a-1e51f9fb742c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "vcpus": 1, "swap": 0}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:12.781923 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:22:12.781923 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 09 18:22:12.809628 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-d625fdf7-c8fd-4534-9f1a-1e51f9fb742c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103122 May 09 18:22:12.810292 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:13.030382 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-1780db16-85db-4bde-9fb9-b4902f0b69f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:13.033955 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:22:13.033955 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 09 18:22:13.084038 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-1780db16-85db-4bde-9fb9-b4902f0b69f6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264776 May 09 18:22:13.084805 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Mon May 9 18:22:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:22:15.388746 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-d625fdf7-c8fd-4534-9f1a-1e51f9fb742c admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:15.390748 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-d625fdf7-c8fd-4534-9f1a-1e51f9fb742c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 09 18:22:15.394095 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:15.503370 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-422ecd38-861f-4248-8a6f-722e0eb56566 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "disk": 5, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:15.521760 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:22:15.521760 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 09 18:22:15.539901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-422ecd38-861f-4248-8a6f-722e0eb56566 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139816 May 09 18:22:15.540469 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:15.551898 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-fc2145b9-0062-4767-b7fd-f1aba4a1d688 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:15.553384 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:22:15.553384 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 09 18:22:15.585202 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-fc2145b9-0062-4767-b7fd-f1aba4a1d688 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036839 May 09 18:22:15.585709 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Mon May 9 18:22:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:22:17.856920 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-422ecd38-861f-4248-8a6f-722e0eb56566 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:17.857933 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-422ecd38-861f-4248-8a6f-722e0eb56566 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 09 18:22:17.858490 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:17.917964 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-fa86b046-593b-4cf8-9f91-70cc3f6e3eda admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:17.938111 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-fa86b046-593b-4cf8-9f91-70cc3f6e3eda admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073494 May 09 18:22:17.938799 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:22:17.951134 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-aa8989c3-33a1-4fc1-9c49-223bcc11e505 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:17.978499 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-aa8989c3-33a1-4fc1-9c49-223bcc11e505 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031089 May 09 18:22:17.979207 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Mon May 9 18:22:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:22:20.251707 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-fa86b046-593b-4cf8-9f91-70cc3f6e3eda admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:20.253372 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-fa86b046-593b-4cf8-9f91-70cc3f6e3eda admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 May 09 18:22:20.253783 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:20.313863 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-dbe1c805-f8ee-4517-8b28-e2746c069899 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "disk": 10, "id": "d3", "rxtx_factor": 1.0}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:20.332938 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-dbe1c805-f8ee-4517-8b28-e2746c069899 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072623 May 09 18:22:20.333489 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:20.345465 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-6e76577e-5bdd-4b27-b8f9-53d55a24884f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:20.368777 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-6e76577e-5bdd-4b27-b8f9-53d55a24884f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026973 May 09 18:22:20.369657 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Mon May 9 18:22:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:22:22.625812 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-dbe1c805-f8ee-4517-8b28-e2746c069899 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:22.626811 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-dbe1c805-f8ee-4517-8b28-e2746c069899 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 09 18:22:22.627471 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:22.686193 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-a57c35b4-a9e0-4912-bf4c-c36141ccee22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:22.704338 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-a57c35b4-a9e0-4912-bf4c-c36141ccee22 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071317 May 09 18:22:22.705596 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:22.717246 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4ef1c0a4-bb44-4132-a69f-06f272e475ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:22.741773 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4ef1c0a4-bb44-4132-a69f-06f272e475ca admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028182 May 09 18:22:22.742348 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Mon May 9 18:22:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:22:24.994632 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-a57c35b4-a9e0-4912-bf4c-c36141ccee22 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:24.996270 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-a57c35b4-a9e0-4912-bf4c-c36141ccee22 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 May 09 18:22:24.996917 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:25.058628 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b495f6c7-e400-4d43-87ea-9380c5982f3c admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:25.084783 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-b495f6c7-e400-4d43-87ea-9380c5982f3c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081654 May 09 18:22:25.085616 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Mon May 9 18:22:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:22:27.385595 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-a57c35b4-a9e0-4912-bf4c-c36141ccee22 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:27.386619 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-a57c35b4-a9e0-4912-bf4c-c36141ccee22 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 09 18:22:27.387034 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:27.445903 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-8fa54289-8c29-4913-b30c-3618c0bf2f99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:27.464878 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-8fa54289-8c29-4913-b30c-3618c0bf2f99 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072008 May 09 18:22:27.465425 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:27.477547 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-53c14884-2dc5-4383-a582-4ee535812a5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:27.500631 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-53c14884-2dc5-4383-a582-4ee535812a5b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026673 May 09 18:22:27.501406 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Mon May 9 18:22:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:22:29.850101 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-8fa54289-8c29-4913-b30c-3618c0bf2f99 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:29.851449 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-8fa54289-8c29-4913-b30c-3618c0bf2f99 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001827 May 09 18:22:29.852018 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:29.919844 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c3193dce-939d-4440-b497-890ab047faf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:29.941132 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c3193dce-939d-4440-b497-890ab047faf8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081788 May 09 18:22:29.941828 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:29.954477 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b40fc72f-b220-4b59-b79a-bee283c50e6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:29.980565 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-b40fc72f-b220-4b59-b79a-bee283c50e6d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030682 May 09 18:22:29.981159 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Mon May 9 18:22:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:22:32.757522 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c3193dce-939d-4440-b497-890ab047faf8 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:32.758538 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c3193dce-939d-4440-b497-890ab047faf8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 09 18:22:32.758935 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:32.815037 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-5a096644-9469-4aad-9aad-ebbe5b4bf546 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:32.832023 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-5a096644-9469-4aad-9aad-ebbe5b4bf546 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067399 May 09 18:22:32.832776 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:32.844188 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-fb4509e8-f462-47e7-9391-d5870bda4088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:32.866590 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-fb4509e8-f462-47e7-9391-d5870bda4088 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026143 May 09 18:22:32.867355 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Mon May 9 18:22:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:22:35.112692 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-5a096644-9469-4aad-9aad-ebbe5b4bf546 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:35.113687 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-5a096644-9469-4aad-9aad-ebbe5b4bf546 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 May 09 18:22:35.114200 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:35.169432 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-e106999d-2d7d-484a-852e-193e1ed9e3ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:35.188597 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-e106999d-2d7d-484a-852e-193e1ed9e3ba admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068647 May 09 18:22:35.189138 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:22:35.200543 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-ca1dc518-4188-4530-b590-2238c0a2d22e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:35.223449 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-ca1dc518-4188-4530-b590-2238c0a2d22e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026462 May 09 18:22:35.224019 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Mon May 9 18:22:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:22:37.517676 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-e106999d-2d7d-484a-852e-193e1ed9e3ba admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:22:37.519259 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-e106999d-2d7d-484a-852e-193e1ed9e3ba admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 May 09 18:22:37.519914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:22:37.584194 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-fb1a9654-4c0f-4ea0-9443-4000f02adf95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:37.603950 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-fb1a9654-4c0f-4ea0-9443-4000f02adf95 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078238 May 09 18:22:37.604508 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Mon May 9 18:22:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:22:37.616710 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-d70c2288-9d1b-4d3c-a5f6-8db84298d18e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:22:37.642655 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-d70c2288-9d1b-4d3c-a5f6-8db84298d18e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027406 May 09 18:22:37.642655 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Mon May 9 18:22:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:23:01.613718 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-fb1a9654-4c0f-4ea0-9443-4000f02adf95 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:01.614767 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-fb1a9654-4c0f-4ea0-9443-4000f02adf95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 09 18:23:01.615167 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:01.670955 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-d84b44b5-1d5c-475a-8794-13aac1904071 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:01.688751 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-d84b44b5-1d5c-475a-8794-13aac1904071 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067738 May 09 18:23:01.689289 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Mon May 9 18:23:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:23:02.685978 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-fb1a9654-4c0f-4ea0-9443-4000f02adf95 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:02.686974 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-fb1a9654-4c0f-4ea0-9443-4000f02adf95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 May 09 18:23:02.687393 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:02.881535 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-0b8f8ffe-d649-4220-9a78-250b911e70c5 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:02.887043 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.wsgi [None req-0b8f8ffe-d649-4220-9a78-250b911e70c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-0b8f8ffe-d649-4220-9a78-250b911e70c5 admin admin] Request method failure captured: May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Accept: application/json May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Accept-Encoding: gzip, deflate May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Connection: keep-alive May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Content-Length: 0 May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Host: 10.222.0.25 May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Openstack-Api-Version: compute 2.90 May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Openstack-System-Scope: None May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: User-Agent: python-novaclient May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Auth-Token: gAAAAABieVwGjozt2x7crz2XXzCRSNUP2lR0kZmFCM5IuM0IoLyyE1LlmH0zViDWZF5YQCPpYB_rsb85vlZVY3tLiJW07ceuASrUolhMJQaflGq19uBNxhvUe7PXaRtIePccV6FwYTCnPK-xEfgqdOuqLcE2dUCkmn8VMufyMOgTX9MhD16eskY May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Domain-Id: None May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Domain-Name: None May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Identity-Status: Confirmed May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Is-Admin-Project: True May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Id: default May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Name: Default May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Name: admin May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Role: reader,member,admin May 09 18:23:02.890383 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Roles: reader,member,admin May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/969d4448da94407dbcabadb61787000d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_969d4448da94407dbcabadb61787000d"}]}] May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant: admin May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant-Name: admin May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User: admin May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Id: default May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Name: Default May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Id: a379c334e6cd446c80b18fda6ce9162e May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Name: admin May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: method: > May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: exception: Flavor 42 could not be found. May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: action_args: {'id': '42'} May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:23:02.892026 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:02.892904 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:02.894099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-0b8f8ffe-d649-4220-9a78-250b911e70c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:23:02.895284 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-0b8f8ffe-d649-4220-9a78-250b911e70c5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060475 May 09 18:23:02.895284 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Mon May 9 18:23:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:23:02.901327 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-dd566073-5cf2-4c62-a276-27cd69625401 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:02.922093 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-dd566073-5cf2-4c62-a276-27cd69625401 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024258 May 09 18:23:02.922616 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Mon May 9 18:23:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:23:02.932901 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-86af71bd-d056-40bc-a335-0d034975ce44 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:02.953496 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-86af71bd-d056-40bc-a335-0d034975ce44 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024128 May 09 18:23:02.954021 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Mon May 9 18:23:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:23:02.963370 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b13ad1ab-34a8-421d-944a-5eecd510bfae admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:02.969531 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.wsgi [None req-b13ad1ab-34a8-421d-944a-5eecd510bfae admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b13ad1ab-34a8-421d-944a-5eecd510bfae admin admin] Request method failure captured: May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Accept: application/json May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Accept-Encoding: gzip, deflate May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Connection: keep-alive May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Content-Length: 0 May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Host: 10.222.0.25 May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Openstack-Api-Version: compute 2.90 May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Openstack-System-Scope: None May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: User-Agent: python-novaclient May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Auth-Token: gAAAAABieVwGjozt2x7crz2XXzCRSNUP2lR0kZmFCM5IuM0IoLyyE1LlmH0zViDWZF5YQCPpYB_rsb85vlZVY3tLiJW07ceuASrUolhMJQaflGq19uBNxhvUe7PXaRtIePccV6FwYTCnPK-xEfgqdOuqLcE2dUCkmn8VMufyMOgTX9MhD16eskY May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Domain-Id: None May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Domain-Name: None May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Identity-Status: Confirmed May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Is-Admin-Project: True May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Id: default May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Name: Default May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Name: admin May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Role: reader,member,admin May 09 18:23:02.973354 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Roles: reader,member,admin May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/969d4448da94407dbcabadb61787000d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_969d4448da94407dbcabadb61787000d"}]}] May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant: admin May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant-Name: admin May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User: admin May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Id: default May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Name: Default May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Id: a379c334e6cd446c80b18fda6ce9162e May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Name: admin May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: method: > May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: exception: Flavor 42 could not be found. May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: action_args: {'id': '42'} May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:23:02.974676 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:02.975540 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:02.976609 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b13ad1ab-34a8-421d-944a-5eecd510bfae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:23:02.977634 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-b13ad1ab-34a8-421d-944a-5eecd510bfae admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015059 May 09 18:23:02.977634 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Mon May 9 18:23:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:23:03.846987 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-86af71bd-d056-40bc-a335-0d034975ce44 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:03.848032 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-86af71bd-d056-40bc-a335-0d034975ce44 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 09 18:23:03.848423 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:04.034870 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-290f4986-52f2-42b1-877d-9facabde7a84 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:04.040157 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.wsgi [None req-290f4986-52f2-42b1-877d-9facabde7a84 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-290f4986-52f2-42b1-877d-9facabde7a84 admin admin] Request method failure captured: May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Accept: application/json May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Accept-Encoding: gzip, deflate May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Connection: keep-alive May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Content-Length: 0 May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Host: 10.222.0.25 May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Openstack-Api-Version: compute 2.90 May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Openstack-System-Scope: None May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: User-Agent: python-novaclient May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Auth-Token: gAAAAABieVwHh7yTwtJuK3byo0RKSvpKy_B9R81YqE91oSpbWZyMeVrGeuXgv1j1jip4wEM53E8D2F7keF1tQ_H4JekFwZoGWhoUZ4Imbh_IqHq4L1GO2FLwfNV2113zuWT5RnJirzpDmkuJ7-jB87Ivyn_x2xlNOAIWoHk8lUH2OwN61dSBt5A May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Domain-Id: None May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Domain-Name: None May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Identity-Status: Confirmed May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Is-Admin-Project: True May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Id: default May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Name: Default May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Name: admin May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Role: reader,member,admin May 09 18:23:04.041647 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Roles: reader,member,admin May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/969d4448da94407dbcabadb61787000d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_969d4448da94407dbcabadb61787000d"}]}] May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant: admin May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant-Name: admin May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User: admin May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Id: default May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Name: Default May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Id: a379c334e6cd446c80b18fda6ce9162e May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Name: admin May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: method: > May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: exception: Flavor 84 could not be found. May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: action_args: {'id': '84'} May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:23:04.043216 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:04.044178 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:04.045453 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-290f4986-52f2-42b1-877d-9facabde7a84 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:23:04.046694 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-290f4986-52f2-42b1-877d-9facabde7a84 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059837 May 09 18:23:04.046694 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Mon May 9 18:23:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:23:04.053329 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-9ab333a8-815f-4b31-af31-77039ddeb942 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:04.067398 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-9ab333a8-815f-4b31-af31-77039ddeb942 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018026 May 09 18:23:04.067862 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Mon May 9 18:23:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:23:04.076922 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f033cc4f-64be-442e-8f5e-a9ca5c877266 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:04.090226 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-f033cc4f-64be-442e-8f5e-a9ca5c877266 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016694 May 09 18:23:04.090741 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Mon May 9 18:23:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:23:04.100092 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-34aa576e-a3e9-4187-bf8d-5b5e64e1a941 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:04.105154 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.wsgi [None req-34aa576e-a3e9-4187-bf8d-5b5e64e1a941 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-34aa576e-a3e9-4187-bf8d-5b5e64e1a941 admin admin] Request method failure captured: May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Accept: application/json May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Accept-Encoding: gzip, deflate May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Connection: keep-alive May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Content-Length: 0 May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Host: 10.222.0.25 May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Openstack-Api-Version: compute 2.90 May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Openstack-System-Scope: None May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: User-Agent: python-novaclient May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Auth-Token: gAAAAABieVwHh7yTwtJuK3byo0RKSvpKy_B9R81YqE91oSpbWZyMeVrGeuXgv1j1jip4wEM53E8D2F7keF1tQ_H4JekFwZoGWhoUZ4Imbh_IqHq4L1GO2FLwfNV2113zuWT5RnJirzpDmkuJ7-jB87Ivyn_x2xlNOAIWoHk8lUH2OwN61dSBt5A May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Domain-Id: None May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Domain-Name: None May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Identity-Status: Confirmed May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Is-Admin-Project: True May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Id: default May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Name: Default May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Name: admin May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Role: reader,member,admin May 09 18:23:04.106668 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Roles: reader,member,admin May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/969d4448da94407dbcabadb61787000d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_969d4448da94407dbcabadb61787000d"}]}] May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant: admin May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant-Name: admin May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User: admin May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Id: default May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Name: Default May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Id: a379c334e6cd446c80b18fda6ce9162e May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Name: admin May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: method: > May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: exception: Flavor 84 could not be found. May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: action_args: {'id': '84'} May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:23:04.108225 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:04.109144 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:04.110337 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-34aa576e-a3e9-4187-bf8d-5b5e64e1a941 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:23:04.111468 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-34aa576e-a3e9-4187-bf8d-5b5e64e1a941 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011897 May 09 18:23:04.111468 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Mon May 9 18:23:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:23:04.986086 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f033cc4f-64be-442e-8f5e-a9ca5c877266 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:04.987095 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-f033cc4f-64be-442e-8f5e-a9ca5c877266 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 09 18:23:04.987552 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:05.170852 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-9ea5fee9-9ef2-4c5c-89a7-836005f7b72d admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:05.176431 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.wsgi [None req-9ea5fee9-9ef2-4c5c-89a7-836005f7b72d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-9ea5fee9-9ef2-4c5c-89a7-836005f7b72d admin admin] Request method failure captured: May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Accept: application/json May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Accept-Encoding: gzip, deflate May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Connection: keep-alive May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Content-Length: 0 May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Host: 10.222.0.25 May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Openstack-Api-Version: compute 2.90 May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Openstack-System-Scope: None May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: User-Agent: python-novaclient May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Auth-Token: gAAAAABieVwIVR-mEPM-qAZUBbn4SCIDqP1Cfk4AqnqaqXqu0fjdmKknwD9QTqfIlxMQQjdKB-DAT78ueB0EpqYnt79ebof25j1oKUvnzNBvGt9It7FbUs4KG5OUvYYJN4VRvhMTfhAqa58uoUi2rVaRWfbDoUaNFeIYSJS2LBQPwvSUS0U52SY May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Domain-Id: None May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Domain-Name: None May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Identity-Status: Confirmed May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Is-Admin-Project: True May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Id: default May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Name: Default May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Project-Name: admin May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Role: reader,member,admin May 09 18:23:05.177914 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Roles: reader,member,admin May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/969d4448da94407dbcabadb61787000d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_969d4448da94407dbcabadb61787000d"}]}] May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant: admin May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-Tenant-Name: admin May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User: admin May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Id: default May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Name: Default May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Id: a379c334e6cd446c80b18fda6ce9162e May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: X-User-Name: admin May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: method: > May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: exception: Flavor 451 could not be found. May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: action_args: {'id': '451'} May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:23:05.179494 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:05.180347 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 09 18:23:05.181759 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-9ea5fee9-9ef2-4c5c-89a7-836005f7b72d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:23:05.182976 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-9ea5fee9-9ef2-4c5c-89a7-836005f7b72d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058883 May 09 18:23:05.182976 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Mon May 9 18:23:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:23:05.188822 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-929753f2-0d40-4f9b-b055-6c8831136e18 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:05.202754 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-929753f2-0d40-4f9b-b055-6c8831136e18 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017457 May 09 18:23:05.203265 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Mon May 9 18:23:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:23:05.213093 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:05.226362 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016801 May 09 18:23:05.226870 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Mon May 9 18:23:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:23:05.235530 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-872c3c07-a472-48f7-9ead-76a5f9c0d506 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:05.241086 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.wsgi [None req-872c3c07-a472-48f7-9ead-76a5f9c0d506 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-872c3c07-a472-48f7-9ead-76a5f9c0d506 admin admin] Request method failure captured: May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Accept: application/json May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Accept-Encoding: gzip, deflate May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Connection: keep-alive May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Content-Length: 0 May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Host: 10.222.0.25 May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Openstack-Api-Version: compute 2.90 May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Openstack-System-Scope: None May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: User-Agent: python-novaclient May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Auth-Token: gAAAAABieVwIVR-mEPM-qAZUBbn4SCIDqP1Cfk4AqnqaqXqu0fjdmKknwD9QTqfIlxMQQjdKB-DAT78ueB0EpqYnt79ebof25j1oKUvnzNBvGt9It7FbUs4KG5OUvYYJN4VRvhMTfhAqa58uoUi2rVaRWfbDoUaNFeIYSJS2LBQPwvSUS0U52SY May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Domain-Id: None May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Domain-Name: None May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Identity-Status: Confirmed May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Is-Admin-Project: True May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Openstack-Nova-Api-Version: 2.90 May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Id: default May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Name: Default May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Project-Name: admin May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Role: reader,member,admin May 09 18:23:05.242567 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Roles: reader,member,admin May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/969d4448da94407dbcabadb61787000d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/969d4448da94407dbcabadb61787000d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_969d4448da94407dbcabadb61787000d"}]}] May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant: admin May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant-Id: 969d4448da94407dbcabadb61787000d May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-Tenant-Name: admin May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User: admin May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Id: default May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Name: Default May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Id: a379c334e6cd446c80b18fda6ce9162e May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: X-User-Name: admin May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: method: > May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: exception: Flavor 451 could not be found. May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: action_args: {'id': '451'} May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:23:05.244113 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:05.244901 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 09 18:23:05.245967 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-872c3c07-a472-48f7-9ead-76a5f9c0d506 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:23:05.247002 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-872c3c07-a472-48f7-9ead-76a5f9c0d506 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011818 May 09 18:23:05.247002 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Mon May 9 18:23:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 18:23:06.122097 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:06.123109 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 09 18:23:06.123538 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:06.310303 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4d96be06-e9aa-4252-a33d-74e479462e31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:23:06.327260 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4d96be06-e9aa-4252-a33d-74e479462e31 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067711 May 09 18:23:06.327795 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Mon May 9 18:23:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:23:07.210464 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:07.211523 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 09 18:23:07.211982 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:07.409607 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-05391167-8d03-4b5f-becc-92f740a7c2e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:23:07.426094 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-05391167-8d03-4b5f-becc-92f740a7c2e2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071554 May 09 18:23:07.426633 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Mon May 9 18:23:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:23:08.305820 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:08.306822 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 09 18:23:08.307233 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:08.497330 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-3c4efc5e-3fb3-4015-aa00-08d9b17374b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:23:08.514762 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-3c4efc5e-3fb3-4015-aa00-08d9b17374b8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069567 May 09 18:23:08.515334 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Mon May 9 18:23:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:23:09.397706 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:09.398702 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 09 18:23:09.399099 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:09.582931 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-8f459d30-63a6-44c7-be4a-2505787cbd35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:23:09.600102 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-8f459d30-63a6-44c7-be4a-2505787cbd35 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067105 May 09 18:23:09.600639 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Mon May 9 18:23:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:23:10.484107 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:10.485118 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 09 18:23:10.485517 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:23:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:23:10.672550 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f2355f63-d665-43b8-b276-bccb2b8f05d5 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:23:10.692390 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-f2355f63-d665-43b8-b276-bccb2b8f05d5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069959 May 09 18:23:10.692920 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Mon May 9 18:23:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:12.487483 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:12.488485 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-2ebe4cf4-d444-4d2f-8f6d-1d394de556df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 09 18:24:12.488880 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Mon May 9 18:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:24:12.545538 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-70126fae-5071-47cf-91f3-1bd0d7717f13 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:12.568639 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-70126fae-5071-47cf-91f3-1bd0d7717f13 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073972 May 09 18:24:12.569176 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Mon May 9 18:24:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:24:12.591910 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-1a66f0b5-f032-4602-8235-6cecfddd1554 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:12.599522 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-1a66f0b5-f032-4602-8235-6cecfddd1554 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011748 May 09 18:24:12.600051 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Mon May 9 18:24:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:12.610975 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-94d437bb-d317-4a4f-93f2-63519042efa7 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:12.618588 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-94d437bb-d317-4a4f-93f2-63519042efa7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011155 May 09 18:24:12.619096 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Mon May 9 18:24:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:12.630566 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:12.637798 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011126 May 09 18:24:12.638307 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Mon May 9 18:24:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:24:12.649522 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-ab666a0f-1677-4e7f-8115-d77fb34bd45c admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:24:12.656807 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-ab666a0f-1677-4e7f-8115-d77fb34bd45c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010694 May 09 18:24:12.657349 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Mon May 9 18:24:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:27:34.308249 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:34.309311 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 09 18:27:34.309704 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:27:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:27:34.570468 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b0cbfb5b-c589-47e0-98ef-7d092c2d41c2 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:34.571677 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:27:34.571677 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 09 18:27:34.572923 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-b0cbfb5b-c589-47e0-98ef-7d092c2d41c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:34.573369 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-b0cbfb5b-c589-47e0-98ef-7d092c2d41c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:34.574157 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-b0cbfb5b-c589-47e0-98ef-7d092c2d41c2 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:34.574596 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-b0cbfb5b-c589-47e0-98ef-7d092c2d41c2 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:34.611469 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-b0cbfb5b-c589-47e0-98ef-7d092c2d41c2 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150845 May 09 18:27:34.612041 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Mon May 9 18:27:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:27:35.497699 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:35.498654 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 09 18:27:35.499048 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:27:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:27:35.689146 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-a12fd799-98c0-4657-8da0-6d3399408185 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:35.690339 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:27:35.690339 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 09 18:27:35.691877 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-a12fd799-98c0-4657-8da0-6d3399408185 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:35.692651 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-a12fd799-98c0-4657-8da0-6d3399408185 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:35.693819 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-a12fd799-98c0-4657-8da0-6d3399408185 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:35.694399 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-a12fd799-98c0-4657-8da0-6d3399408185 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:35.714188 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-a12fd799-98c0-4657-8da0-6d3399408185 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077334 May 09 18:27:35.714757 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Mon May 9 18:27:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:27:47.030166 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:47.031214 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 09 18:27:47.031608 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:27:47.224235 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-6c46683a-c6e9-4b8d-bad9-204d1609c6b4 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:47.225405 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:27:47.225405 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 09 18:27:47.226579 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-6c46683a-c6e9-4b8d-bad9-204d1609c6b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:47.227023 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-6c46683a-c6e9-4b8d-bad9-204d1609c6b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:47.227838 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-6c46683a-c6e9-4b8d-bad9-204d1609c6b4 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:47.228269 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-6c46683a-c6e9-4b8d-bad9-204d1609c6b4 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:47.253587 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-6c46683a-c6e9-4b8d-bad9-204d1609c6b4 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079433 May 09 18:27:47.254124 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Mon May 9 18:27:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:27:48.157376 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:48.158897 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-b132e5c0-47f1-40b9-b2ff-e8cfe768913f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001938 May 09 18:27:48.159329 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Mon May 9 18:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:27:48.354320 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-0c180acc-f29b-4b38-8d22-5fb457e9ad59 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:27:48.355542 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 18:27:48.355542 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 09 18:27:48.356720 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-0c180acc-f29b-4b38-8d22-5fb457e9ad59 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:48.357172 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-0c180acc-f29b-4b38-8d22-5fb457e9ad59 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:48.357966 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-0c180acc-f29b-4b38-8d22-5fb457e9ad59 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:27:48.358431 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-0c180acc-f29b-4b38-8d22-5fb457e9ad59 admin admin] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:27:48.379530 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-0c180acc-f29b-4b38-8d22-5fb457e9ad59 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076181 May 09 18:27:48.380075 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Mon May 9 18:27:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:28:45.332243 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: Mon May 9 18:28:45 2022 - graceful shutdown triggered... May 09 18:28:45.332254 dv-cinder-841125-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 09 18:28:45.333431 dv-cinder-841125-3-iscsi devstack@n-api.service[102549]: Gracefully killing worker 1 (pid: 102549)... May 09 18:28:45.333837 dv-cinder-841125-3-iscsi devstack@n-api.service[102550]: Gracefully killing worker 2 (pid: 102550)... May 09 18:28:46.334507 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: worker 1 buried after 1 seconds May 09 18:28:46.334949 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: worker 2 buried after 1 seconds May 09 18:28:46.334949 dv-cinder-841125-3-iscsi devstack@n-api.service[102548]: goodbye to uWSGI. May 09 18:28:46.336143 dv-cinder-841125-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 09 18:28:46.336705 dv-cinder-841125-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 09 18:28:46.339468 dv-cinder-841125-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 18:28:46.354198 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 18:28:46 2022] *** May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: nodename: dv-cinder-841125-3-iscsi May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: machine: x86_64 May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: clock source: unix May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: pcre jit disabled May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: detected number of CPU cores: 4 May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: current working directory: / May 09 18:28:46.379374 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: detected binary path: /usr/bin/uwsgi-core May 09 18:28:46.380087 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: your processes number limit is 47680 May 09 18:28:46.380087 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: your memory page size is 4096 bytes May 09 18:28:46.380087 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: detected max file descriptor number: 2048 May 09 18:28:46.380087 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: lock engine: pthread robust mutexes May 09 18:28:46.380087 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: thunder lock: enabled May 09 18:28:46.380087 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 18:28:46.380087 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 18:28:46.429582 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: Python main interpreter initialized at 0x5557b44679c0 May 09 18:28:46.429582 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: python threads support enabled May 09 18:28:46.429582 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: your server socket listen backlog is limited to 100 connections May 09 18:28:46.429582 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: your mercy for graceful operations on workers is 90 seconds May 09 18:28:46.430024 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: mapped 403077 bytes (393 KB) for 2 cores May 09 18:28:46.430024 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: *** Operational MODE: preforking *** May 09 18:28:46.430280 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: *** uWSGI is running in multiple interpreter mode *** May 09 18:28:46.430280 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: spawned uWSGI master process (pid: 117072) May 09 18:28:46.430481 dv-cinder-841125-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 18:28:46.431401 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: spawned uWSGI worker 1 (pid: 117087, cores: 1) May 09 18:28:46.431535 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: spawned uWSGI worker 2 (pid: 117088, cores: 1) May 09 18:28:46.431619 dv-cinder-841125-3-iscsi devstack@n-api.service[117072]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 18:28:47.639397 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:28:47.642477 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 18:28:48.452288 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:28:48.452288 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: from cryptography.utils import int_from_bytes May 09 18:28:48.452618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:28:48.452618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: from cryptography.utils import int_from_bytes May 09 18:28:48.452791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:28:48.452791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: from cryptography.utils import int_from_bytes May 09 18:28:48.453103 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 18:28:48.453103 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: from cryptography.utils import int_from_bytes May 09 18:28:50.913253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:28:50.913936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:28:50.914218 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:28:50.914417 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:28:50.914689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:28:50.915080 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 18:28:50.915537 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.915630 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 18:28:50.915713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.915794 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.916006 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 18:28:50.916135 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.916336 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 18:28:50.916436 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.916589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 18:28:50.916748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.916960 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.917079 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.917290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.917399 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.917628 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.917770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.917936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.918049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.918265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.918393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.918606 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.918720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-3-iscsi {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.918943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.919055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.919291 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.919415 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.919614 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.919728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.919892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.920041 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.920221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.920409 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.920559 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-3-iscsi {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.920711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.920877 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.921031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.921178 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.921378 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.921580 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.921819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.922139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.922483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.923478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.923733 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.923979 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.924209 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.924437 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.924648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.924873 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.925096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.925343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.925556 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.925777 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.925998 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.926231 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.926442 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.926759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.926982 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.927228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.927452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.927665 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.927876 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.928100 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-3-iscsi {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.928317 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.928505 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.928712 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.928919 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.929094 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-3-iscsi {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.929278 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.929435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.929590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.929755 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.929903 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.930643 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.931120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.931365 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.931528 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.931704 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.932350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.932553 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.932727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.932876 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.933035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.933375 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.933531 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.933686 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.933845 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.934075 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.934230 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.934386 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.934546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.934703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.934861 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.935008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.935162 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.935346 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.935492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.935651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.935813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.935970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.936126 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.936282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.936450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.936624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.936788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.936935 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.937081 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.937235 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.937382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.937542 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.937689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.937837 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.937990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.938150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.938322 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.938322 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.939248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.939248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.939556 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.939715 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.939873 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.940026 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.940184 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.940339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.940488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.940655 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.940811 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.941364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.941530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.941687 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.941842 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.942004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.942166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.942483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.942638 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.942796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.942954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.943108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.943315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.943808 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.943975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.944138 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.944304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.944459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.944607 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.944750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.945069 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.945236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.945614 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.945722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.945810 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.945895 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.945988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946076 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946171 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946258 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946633 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946731 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.946923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947010 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947101 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947254 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947354 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947533 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947892 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.947892 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948054 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948232 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948412 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948504 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948597 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948683 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948776 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948869 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.948961 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949056 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949142 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949318 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949404 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949488 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949572 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949663 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949859 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.949953 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950045 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950331 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950432 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950519 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950604 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950784 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950868 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.950962 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.951076 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.951514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.951608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.951707 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.951810 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.951897 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.951982 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952074 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952253 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952468 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952563 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952663 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952751 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952843 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.952928 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953094 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953183 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953361 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953551 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953645 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.953739 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.954009 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.954116 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.954296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.954408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.954614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.954717 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.954947 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.955041 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.955304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.955418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.955626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.955728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.955944 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.956044 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.956261 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.956355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.956573 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.956709 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.956888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.957026 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.957204 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.957337 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.957519 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.957639 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.957832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.957952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.958147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.958268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.958453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.958573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.958769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.958896 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.959084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.959225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.959428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.959561 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.959744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.959880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.960056 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.960183 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.960386 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.960522 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.960707 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.960854 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.961029 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.961163 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.961348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.961710 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.961844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 18:28:50.961985 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.962126 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.962258 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.962390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.962531 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.962671 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.963479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.963624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.963766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.963858 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964037 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964685 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.964862 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.965050 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.965196 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.965378 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.965515 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.965703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.965826 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.966027 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.966159 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.966359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.966490 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.966768 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.966897 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.967732 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.967936 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968064 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968317 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968436 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968563 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968685 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.968927 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969272 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969394 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969641 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969760 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.969888 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.970067 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.970188 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.970389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.970512 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.970711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.970832 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.971074 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.972796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.972957 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.973096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.973232 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.973372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.973505 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.973651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.973785 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.973924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.974058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.974197 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.974337 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.974479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.974619 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.974759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.974891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.975023 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.975170 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.975440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.975586 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.975726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.975859 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.975991 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976412 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976499 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976499 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976499 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976731 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976830 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.976926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.977020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.977113 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.977206 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.977377 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.977481 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.977704 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.977814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.978031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.978124 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.978356 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.978457 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.978674 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.978812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.978990 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.979082 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.979338 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.979689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.979795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.979900 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.979996 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.980185 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.980447 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.980546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.980780 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.980875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.981130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.981237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.981450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.981543 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.981767 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.981870 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.982089 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.982191 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.982410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.982510 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.982735 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.982889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.983070 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.983217 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.983418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.983520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.983733 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.983841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.984065 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.984180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.984379 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.984480 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.984695 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.984802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.985018 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.985118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.985340 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.985992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.986188 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.986346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.986494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.986586 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.986814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.986916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.987135 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.987241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.987480 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.987574 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.987803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.987904 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.988138 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.988247 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.988464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.988559 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.988778 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.988878 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.989116 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.989223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.989454 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.989571 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.989776 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.989890 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.990089 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.990205 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.990411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.990512 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.990729 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.990831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.991045 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.991155 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.991391 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.991502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.991711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.991811 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.992027 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.992139 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.992340 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.992445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.992655 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.992781 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.992969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.993076 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.993316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.993424 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.993634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.993742 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.993949 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.994050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.994260 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.994359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.994575 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.994682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.994888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.994989 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.995231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.995356 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.995565 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.995659 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.995881 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.996002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.996246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.996376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.996539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.996692 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.996887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.996989 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.997212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.997313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.997538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.997641 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.997860 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.997961 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.998183 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.998285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.998502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.998603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.998820 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.998920 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.999146 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.999341 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.999493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.999610 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.999818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:50.999920 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.000138 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.000233 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.000460 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.000554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.000783 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.000883 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.001156 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.001764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.001984 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.002130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.002311 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.002446 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.002645 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.002749 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.003272 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.003385 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.003570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.003664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.003923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.004025 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.004271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.004366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.004602 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.004695 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.004923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.005024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.005247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.005341 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.005565 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.005659 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.005885 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.005993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.006210 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.006368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.006510 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.006656 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.006869 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.006980 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.007157 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.007395 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.007541 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.007679 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.007811 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.007951 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.008123 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.008219 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.008434 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.008527 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.008757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.008863 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.009088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.009180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.009407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.009507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.009734 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.009829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.010060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.010196 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.010392 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.010535 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.010711 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.010807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.011029 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.011129 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.011373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.011476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.011690 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.011796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.012007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.012110 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.012325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.012417 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.012638 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.012740 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.012956 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.013049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.013275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.013452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.013583 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.013676 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.013902 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.013994 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.014218 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.014324 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.014532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.014628 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.014843 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.014943 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.015165 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.015302 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.015505 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.015600 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.015819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.015921 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.016143 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.016248 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.016473 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.016568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.016819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.016964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.017155 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.017264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.017492 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.017594 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.017808 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.017899 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.018121 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.018227 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.018434 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.018534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.018749 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.018849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.019064 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.019157 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.019404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.019498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.019723 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.019816 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.020051 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.020146 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.020381 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.020482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.020693 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.020792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.021014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.021108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.021333 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.021426 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.021650 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.021756 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.021976 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.022070 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.022294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.022393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.022611 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.022718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.022932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.023024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.023276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.023400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.023602 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.023725 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.023921 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.024014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.024253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.024354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.024573 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.024680 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.024892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.024992 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.025209 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.025301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.025526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.025629 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.025846 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.025940 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.026164 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.026264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.026483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.026754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.026848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.027099 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.027212 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.027451 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.027721 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.027866 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.028067 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.028177 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.028395 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.028499 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.028726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.028829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.029059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.029159 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.029391 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.029494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.029707 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.029807 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.030033 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.030136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.030350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.030452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.030666 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.030774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.030986 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.031079 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.031332 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.031433 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.031665 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.031814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.031964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.032073 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.032304 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.032405 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.032624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.032728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.032938 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.033031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.033252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.033359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.033565 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.033691 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.033892 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.033997 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.034203 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.034347 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.034521 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.034623 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.034832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.034925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.035151 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.035318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.035495 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.035588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.035810 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.035913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.036125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.036229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.036443 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.036577 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.036762 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.036877 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.037083 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.037243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.037388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.037522 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.037739 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.037850 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.038058 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.038153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.038390 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.038483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.038705 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.038808 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.039040 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.039144 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.039381 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.039486 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.039695 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.039789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.040016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.040112 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.040329 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.040422 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.040642 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.040749 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.040953 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.041055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.041270 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.041363 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.041585 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.041756 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.041900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.041992 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.042213 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.042306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.042524 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.042626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.042839 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.042940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.043149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.043264 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.043483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.043590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.043800 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.043915 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.044115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.044222 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.044424 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.044528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.044742 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.044837 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.045058 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.045153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.045367 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.045461 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.045685 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.045778 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.045997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.046099 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.046311 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.046406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.046622 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.046716 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.046933 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.047035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.047276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.047387 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.047591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.047726 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.048418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.048541 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.048734 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.048837 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.049054 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.049148 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.049375 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.049548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.049687 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.049789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.050001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.050143 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.050324 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.050448 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.050638 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.050740 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.050947 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.051062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.051290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.051416 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.051609 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.051756 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.051926 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.052050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.052245 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.052349 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.052569 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.052671 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.052886 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.052994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.053199 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.053306 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.053507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.053611 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.053820 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.053944 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.054127 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.054223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.054439 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.054535 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.054750 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.054847 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.055059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.055162 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.055395 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.055490 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.055707 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.055817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.056027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.056130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.056339 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.056442 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.056652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.056757 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.056963 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.057068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.057273 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.057384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.057591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.057702 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.057911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.058010 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.058266 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.058368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.058583 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.058694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.058907 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.059005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.059249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.059348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.059571 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.059668 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.059892 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.059997 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.060204 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.060301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.060524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.060619 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.060841 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.060946 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.061154 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.061258 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.061464 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.061566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.061775 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.061879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.062106 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.062236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.062427 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.062525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.062744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.062840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.063074 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.063214 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.063421 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.063558 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.064389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.064491 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.064652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.064761 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.064972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.065069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.065294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.065386 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.065615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.065726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.065936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.066037 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.066255 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.066351 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.066575 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.066678 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.066898 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.067008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.067240 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.067351 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.067567 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.067696 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068131 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068226 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068623 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.068905 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.069118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.069219 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.069445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.069548 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.069761 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.069854 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.070077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.070168 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.070398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.070493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.070713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.070815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.071027 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.071119 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.071365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.071468 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.071680 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.071807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.072004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.072130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.072321 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.072450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.072764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.072864 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.073082 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.073189 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.073407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.073530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.073725 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.073827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.074043 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.074154 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.074378 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.074485 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.074680 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.074781 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.075005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.075120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.075348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.075458 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.075731 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.075838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.076050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.076151 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.076365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.076504 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.076689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.076795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.077020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.077113 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.077331 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.077432 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.077645 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.077811 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078410 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078712 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078888 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.078984 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.079269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.079371 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.079589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.079764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.079924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.080027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.080370 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.080467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.080685 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.080789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.081006 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.081107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.081338 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.081430 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.081671 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.081773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.082008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.082102 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.082324 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.082425 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.082646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.082749 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.082964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.083069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.083321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.083431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.083658 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.083752 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.083977 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.084081 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.084298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.084407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.084617 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.084732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.084945 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.085098 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.085272 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.085396 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.085591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.085697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.085920 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.086014 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.086251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.086353 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.086582 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.086675 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.086917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.087012 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.087321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.087419 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.087657 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.087751 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.087976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.088296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.088413 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.088511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.088657 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.088780 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.088884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.088986 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.089199 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.089301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.089531 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.089626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.089846 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.089952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.090162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.090269 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.090485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.090587 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.090800 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.090908 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.091114 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.091247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.091452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.091547 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.091772 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.091874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.092087 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.092179 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.092399 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.092500 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.092728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.092831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.093040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.093141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.093376 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.093477 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.093689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.093782 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.094020 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.094121 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.094339 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.094432 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.094659 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.094803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.094997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.095102 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.095336 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.095452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.095652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.095753 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.095970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.096078 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.096286 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.096396 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.096632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.096732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.096950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.097050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.097279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.097389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.097619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.097726 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.097953 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.098092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.098337 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.098493 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.098591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.098717 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.098918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.099108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.099257 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.099484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.099589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.099819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.099922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.100157 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.100266 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.100477 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.100570 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.100787 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.100891 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.101155 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.101266 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.101440 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.101546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.101712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.101815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.102024 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.102198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.102343 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.102436 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.102656 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.102758 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.102970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.103074 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.103309 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.103409 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.103630 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.103726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.103948 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.104053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.104263 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.104358 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.104588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.104739 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.104945 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.105041 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.105215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.105309 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.105533 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.105635 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.105880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.105983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.106194 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.106288 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.106523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.106629 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.106858 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.106954 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.107194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.107305 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.107531 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.107635 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.107851 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.107952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.108177 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.108300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.108506 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.108664 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.108829 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.108932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.109153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.109254 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.109473 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.109581 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.109799 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.109894 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.110122 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.110215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.110997 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.111269 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.111384 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.111674 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.111821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.112001 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.112162 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.112333 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.112488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.112814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.112919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.113137 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.113242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.113463 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.113566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.113789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.113891 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.114110 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.114215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.114431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.114528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.114750 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.114846 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.115074 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.115212 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.115436 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.115533 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.115761 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.115857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.116084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.116180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.116423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.116516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.116746 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.116840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.117069 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.117165 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.117393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.117489 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.117715 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.117826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.118054 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.118156 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.118393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.118632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.118772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.118879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.118998 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.119101 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.119347 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.119457 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.119673 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.119770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.119996 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.120090 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.120318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.120414 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.120641 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.120737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.120963 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.121057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.121282 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.121375 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.121601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.121763 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.121923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.122017 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.122241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.122344 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.122558 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.122660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.122882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.122977 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.123281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.123393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.123623 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.123716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.123947 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.124040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.124273 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.124376 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.124595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.124805 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.124908 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.125134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.125250 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.125470 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.125754 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.125851 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.126132 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.126716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.126981 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.127085 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.127337 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.127433 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.127675 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.127771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.128244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.128349 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.128563 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.128680 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.128884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.128996 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.129202 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.129298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.129517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.129625 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.129838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.129946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.130157 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.130250 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.130472 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.130565 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.130799 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.130907 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.131118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.131277 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.131460 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.131730 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.131835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.132044 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.132140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.132372 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.132634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.132736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.133000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.133107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.133335 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.133430 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.133649 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.133750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.133983 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.134081 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.134300 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.134395 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.134616 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.134719 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.134941 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.135044 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.135290 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.135408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.135606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.135702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.135920 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.136016 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.136238 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.136334 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.136555 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.136650 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.136866 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.136960 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.137184 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.137278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.137498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.137604 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.137813 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.137910 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.138137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.138239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.138449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.138566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.138767 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.138886 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.139088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.139243 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.139423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.139575 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.139737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.139833 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.140053 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.140146 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.140366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.140470 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.140682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.140776 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.140997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.141091 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.141312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.141406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.141638 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.141744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.141964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.142059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.142279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.142487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.142597 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.142684 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.142906 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.143007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.143254 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.143354 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.143583 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.143690 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.143899 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.144000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.144225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.144328 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.144545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.144647 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.144878 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.144983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.145199 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.145315 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.145522 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.145627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.145855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.145961 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.146180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.146283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.146502 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.146724 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.146862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.147075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.147206 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.147434 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.147752 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.147858 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.148107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.148211 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.148424 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.148524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.148745 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.148902 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.149065 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.149179 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.149404 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.149509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.149723 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.149817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.150040 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.150153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.150360 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.150463 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.150678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.150773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.150999 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.151093 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.151342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.151441 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.151664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.151769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.151984 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.152078 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.152300 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.152395 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.152617 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.152727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.152937 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.153031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.153256 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.153357 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.153573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.153677 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.153894 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.153988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.154214 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.154318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.154540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.154636 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.154860 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.154954 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.155200 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.155299 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.155558 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.155690 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.155887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.156000 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.156216 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.156325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.156537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.156647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.156858 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.156958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.157183 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.157303 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.157532 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.157632 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.157847 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.157954 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.158188 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.158298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.158518 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.158628 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.158835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.158961 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.159245 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.159374 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.159566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.159667 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.159900 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.160003 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.160234 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.160339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.160556 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.160651 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.160883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.160977 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.161209 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.161312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.161530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.161624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.161865 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.161967 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.162190 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.162285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.162524 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.162618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.162841 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.162936 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.163154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.163347 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.163491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.163588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.163811 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.163982 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.164138 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.164241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.164452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.164546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.164763 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.164872 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.165077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.165175 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.165393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.165488 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.165705 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.165815 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.166016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.166118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.166329 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.166431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.166641 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.166737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.166955 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.167050 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.167290 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.167389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.167605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.167700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.167916 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.168032 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.168227 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.168337 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.168535 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.168636 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.168845 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.168943 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.169238 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.169345 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.169465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.169566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.169781 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.169888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.170087 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.170196 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.170400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.170492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.170708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.170811 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.171019 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.171124 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.171361 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.171467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.171678 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.171773 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.172024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.172129 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.172347 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.172441 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.172677 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.172772 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.173504 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.173622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.173836 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.173937 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.174163 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.174258 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.174483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.174587 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.174796 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.174897 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.175134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.175281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.175478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.175582 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.175803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.175908 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.176123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.176220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.176441 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.176549 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.176758 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.176855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.177075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.177181 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.177397 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.177510 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.177718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.177814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.178031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.178136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.178371 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.178480 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.178699 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.178807 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.179027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.179134 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.179378 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.179574 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.179778 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.179875 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.180022 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.180127 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.180345 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.180440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.180663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.180761 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.180993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.181096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.181312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.181414 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.181630 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.181725 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.181952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.182047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.182272 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.182374 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.182597 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.182699 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.182928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.183030 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.183276 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.183374 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.183612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.183717 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.183950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.184045 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.184279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.184380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.184616 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.184723 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.184958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.185052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.185283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.185387 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.185606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.185710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.185922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.186021 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.186177 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:28:51.186279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.186584 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.186912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 18:28:51.187169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 18:28:51.210284 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.211887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.274549 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.context [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6582a570-2abd-4bbd-b400-f90edc06f4a6(cell1) {{(pid=117088) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:28:51.276560 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.context [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6582a570-2abd-4bbd-b400-f90edc06f4a6(cell1) {{(pid=117087) load_cells /opt/stack/nova/nova/context.py:464}} May 09 18:28:51.278996 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:28:51.280617 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:28:51.280974 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:28:51.281440 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:28:51.283107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:28:51.283955 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:28:51.284071 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:28:51.285907 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:28:51.295099 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.296887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.299102 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.301073 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.456440 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.461374 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 18:28:51.776418 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:28:51.784248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:28:51.784507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:28:51.794867 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:28:52.130055 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:28:52.136188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-edc9b4f2-47be-4cbc-8425-0a0e71084cf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:28:52.141553 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557b44679c0 pid: 117088 (default app) May 09 18:28:52.142720 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 18:28:52.149011 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-9eebb037-ddaa-43aa-b9cd-21808d0e8f9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 18:28:52.154413 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557b44679c0 pid: 117087 (default app) May 09 18:29:34.951536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-794b6549-ba23-44ab-bfd8-fccdc86f18bd tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Action: 'create', calling method: .version_select at 0x7f3f807d2280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-640250736", "metadata": {"Type": "work"}}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-794b6549-ba23-44ab-bfd8-fccdc86f18bd tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Request method failure captured: May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 121 May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2NKGuCdd7460pEnBX9fua8UydZ5DRAQ5-hn5WiQ3YkiJoUs7oY0o4WYYGwWO_j4fAGOmV8Ft_0yrox3XuAf17iFzyTJWqE-1o7lXd4fEa-JfS6SLL8ucQ14i3dVBL4j1BROlHZW9AyTSVHJRlu6p7IPDdQ1katBsfRpbHE6eKiTj8 May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:29:34.985608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31125b05c5e54ea28bac344b98366385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31125b05c5e54ea28bac344b98366385"}]}] May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesNegativeTest-387055832 May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesNegativeTest-387055832-project May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: a2228dffa3514c39bee2f7c2f41fbc60 May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesNegativeTest-387055832-project May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-640250736", "metadata": {"Type": "work"}}} May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: May 09 18:29:34.987471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-640250736', 'metadata': {'Type': 'work'}}}} May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise error May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi '#$%' May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:34.988444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 18:29:34.990090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 18:29:34.991458 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 18:29:34.991458 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:34.993656 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-794b6549-ba23-44ab-bfd8-fccdc86f18bd tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:34.995170 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-794b6549-ba23-44ab-bfd8-fccdc86f18bd tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.450948 May 09 18:29:34.996150 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Mon May 9 18:29:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1453 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 18:29:35.008149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc2a1d9e-6bf1-4264-9f52-ec5d619a19e8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Action: 'create', calling method: .version_select at 0x7f3f806665e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1528438393", "metadata": {"Type": "work"}}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc2a1d9e-6bf1-4264-9f52-ec5d619a19e8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Request method failure captured: May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 120 May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2NKGuCdd7460pEnBX9fua8UydZ5DRAQ5-hn5WiQ3YkiJoUs7oY0o4WYYGwWO_j4fAGOmV8Ft_0yrox3XuAf17iFzyTJWqE-1o7lXd4fEa-JfS6SLL8ucQ14i3dVBL4j1BROlHZW9AyTSVHJRlu6p7IPDdQ1katBsfRpbHE6eKiTj8 May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:29:35.016798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31125b05c5e54ea28bac344b98366385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31125b05c5e54ea28bac344b98366385"}]}] May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesNegativeTest-387055832 May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesNegativeTest-387055832-project May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: a2228dffa3514c39bee2f7c2f41fbc60 May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesNegativeTest-387055832-project May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1528438393", "metadata": {"Type": "work"}}} May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: May 09 18:29:35.018503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1528438393', 'metadata': {'Type': 'work'}}}} May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise error May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi '0' May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:35.019429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 18:29:35.020946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 18:29:35.022278 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 18:29:35.022278 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.027451 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc2a1d9e-6bf1-4264-9f52-ec5d619a19e8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:35.028497 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fc2a1d9e-6bf1-4264-9f52-ec5d619a19e8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026393 May 09 18:29:35.029282 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 2/2] 10.222.0.25 () {60 vars in 1155 bytes} [Mon May 9 18:29:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 18:29:35.039420 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-87e18782-d185-483d-9771-894ef1950825 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Action: 'create', calling method: .version_select at 0x7f3f807d25e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-494062669", "metadata": {"Type": "work"}}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-87e18782-d185-483d-9771-894ef1950825 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Request method failure captured: May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 118 May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2NKGuCdd7460pEnBX9fua8UydZ5DRAQ5-hn5WiQ3YkiJoUs7oY0o4WYYGwWO_j4fAGOmV8Ft_0yrox3XuAf17iFzyTJWqE-1o7lXd4fEa-JfS6SLL8ucQ14i3dVBL4j1BROlHZW9AyTSVHJRlu6p7IPDdQ1katBsfRpbHE6eKiTj8 May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:29:35.050554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31125b05c5e54ea28bac344b98366385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31125b05c5e54ea28bac344b98366385"}]}] May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesNegativeTest-387055832 May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesNegativeTest-387055832-project May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: a2228dffa3514c39bee2f7c2f41fbc60 May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesNegativeTest-387055832-project May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-494062669", "metadata": {"Type": "work"}}} May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: May 09 18:29:35.052161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-494062669', 'metadata': {'Type': 'work'}}}} May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise error May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi '' May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:35.053080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 18:29:35.054627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 18:29:35.055790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 18:29:35.055790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:35.057042 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-87e18782-d185-483d-9771-894ef1950825 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:35.058037 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-87e18782-d185-483d-9771-894ef1950825 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022413 May 09 18:29:35.058758 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 3/3] 10.222.0.25 () {60 vars in 1155 bytes} [Mon May 9 18:29:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 18:29:35.069346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-21120419-4e3a-49c6-84eb-279552f188f8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Calling method '.version_select at 0x7f3f80685280>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:35.351093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c41512db-e358-4982-b355-44698f725cae tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Action: 'create', calling method: .version_select at 0x7f3f807d2280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1235181426"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:36.344250 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-21120419-4e3a-49c6-84eb-279552f188f8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] HTTP exception thrown: Volume tempest-invalid-622616035 could not be found. May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-21120419-4e3a-49c6-84eb-279552f188f8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Request method failure captured: May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-622616035 HTTP/1.1 May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2NKGuCdd7460pEnBX9fua8UydZ5DRAQ5-hn5WiQ3YkiJoUs7oY0o4WYYGwWO_j4fAGOmV8Ft_0yrox3XuAf17iFzyTJWqE-1o7lXd4fEa-JfS6SLL8ucQ14i3dVBL4j1BROlHZW9AyTSVHJRlu6p7IPDdQ1katBsfRpbHE6eKiTj8 May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:29:36.348237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31125b05c5e54ea28bac344b98366385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31125b05c5e54ea28bac344b98366385"}]}] May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesNegativeTest-387055832 May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesNegativeTest-387055832-project May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: a2228dffa3514c39bee2f7c2f41fbc60 May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesNegativeTest-387055832-project May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Volume tempest-invalid-622616035 could not be found. May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'tempest-invalid-622616035'} May 09 18:29:36.349832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-622616035 could not be found. (HTTP 404) (Request-ID: req-d378d969-cbbc-413f-8854-6ff3b85d460b) May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:36.350790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:29:36.352249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-622616035 could not be found. May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:29:36.354221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-622616035 could not be found. May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-622616035 could not be found. May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-21120419-4e3a-49c6-84eb-279552f188f8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Returning 404 to user: Volume tempest-invalid-622616035 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-21120419-4e3a-49c6-84eb-279552f188f8 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-622616035" status: 404 len: 98 microversion: 2.1 time: 1.285443 May 09 18:29:36.356601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 4/4] 10.222.0.25 () {58 vars in 1214 bytes} [Mon May 9 18:29:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-622616035 => generated 98 bytes in 1287 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 09 18:29:36.471861 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-856225835", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "networks": [{"uuid": "9bd9eb17-ecb5-478f-ba90-356efc1ddcaa"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:36.710606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] validate_networks() for [('9bd9eb17-ecb5-478f-ba90-356efc1ddcaa', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:29:37.023150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c41512db-e358-4982-b355-44698f725cae tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.191494 May 09 18:29:37.024749 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 1/5] 10.222.0.25 () {60 vars in 1154 bytes} [Mon May 9 18:29:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3195 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 18:29:37.032054 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f57373cb-dfae-43a1-8c42-d9d544a58ddc tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004132 May 09 18:29:37.032801 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 2/6] 10.222.0.25 () {58 vars in 1139 bytes} [Mon May 9 18:29:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 18:29:37.052573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e897af03-9873-48cb-aca9-b81b6f0355e3 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f8062b4c0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:37.189141 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e897af03-9873-48cb-aca9-b81b6f0355e3 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc" status: 200 len: 345 microversion: 2.1 time: 0.147396 May 09 18:29:37.190113 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:37 2022] GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:37.194998 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-03598271-6f91-4790-afb0-17a53ba28e36 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003788 May 09 18:29:37.195583 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1136 bytes} [Mon May 9 18:29:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 18:29:37.210029 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d7467ee2-8598-4945-87b2-709b9acc909d tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Calling method '.version_select at 0x7f3f8062b3a0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:37.263081 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-d7467ee2-8598-4945-87b2-709b9acc909d tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] HTTP exception thrown: Volume 107ae966-3906-4040-b9d4-a2f658cec8ff could not be found. May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d7467ee2-8598-4945-87b2-709b9acc909d tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Request method failure captured: May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/os-volumes/107ae966-3906-4040-b9d4-a2f658cec8ff HTTP/1.1 May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2NKGuCdd7460pEnBX9fua8UydZ5DRAQ5-hn5WiQ3YkiJoUs7oY0o4WYYGwWO_j4fAGOmV8Ft_0yrox3XuAf17iFzyTJWqE-1o7lXd4fEa-JfS6SLL8ucQ14i3dVBL4j1BROlHZW9AyTSVHJRlu6p7IPDdQ1katBsfRpbHE6eKiTj8 May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:29:37.268909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31125b05c5e54ea28bac344b98366385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31125b05c5e54ea28bac344b98366385"}]}] May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-VolumesNegativeTest-387055832 May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-VolumesNegativeTest-387055832-project May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: a2228dffa3514c39bee2f7c2f41fbc60 May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-VolumesNegativeTest-387055832-project May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Volume 107ae966-3906-4040-b9d4-a2f658cec8ff could not be found. May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '107ae966-3906-4040-b9d4-a2f658cec8ff'} May 09 18:29:37.270290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 107ae966-3906-4040-b9d4-a2f658cec8ff could not be found. (HTTP 404) (Request-ID: req-d648a744-eae5-4fb0-a419-1a61dae747e5) May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:37.271049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:29:37.272220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 107ae966-3906-4040-b9d4-a2f658cec8ff could not be found. May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 18:29:37.273354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 107ae966-3906-4040-b9d4-a2f658cec8ff could not be found. May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 107ae966-3906-4040-b9d4-a2f658cec8ff could not be found. May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d7467ee2-8598-4945-87b2-709b9acc909d tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Returning 404 to user: Volume 107ae966-3906-4040-b9d4-a2f658cec8ff could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d7467ee2-8598-4945-87b2-709b9acc909d tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/107ae966-3906-4040-b9d4-a2f658cec8ff" status: 404 len: 109 microversion: 2.1 time: 0.069445 May 09 18:29:37.274482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:29:37 2022] DELETE /compute/v2.1/os-volumes/107ae966-3906-4040-b9d4-a2f658cec8ff => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:29:37.287586 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bfd2d0db-e8e7-46fd-bd8d-9854f8ce1a12 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Calling method '.version_select at 0x7f3f80713c10>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:37.336748 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-bfd2d0db-e8e7-46fd-bd8d-9854f8ce1a12 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] HTTP exception thrown: Volume d268ec08-c6c8-4b38-8ac9-d733f6851436 could not be found. May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bfd2d0db-e8e7-46fd-bd8d-9854f8ce1a12 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Request method failure captured: May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/os-volumes/d268ec08-c6c8-4b38-8ac9-d733f6851436 HTTP/1.1 May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2NKGuCdd7460pEnBX9fua8UydZ5DRAQ5-hn5WiQ3YkiJoUs7oY0o4WYYGwWO_j4fAGOmV8Ft_0yrox3XuAf17iFzyTJWqE-1o7lXd4fEa-JfS6SLL8ucQ14i3dVBL4j1BROlHZW9AyTSVHJRlu6p7IPDdQ1katBsfRpbHE6eKiTj8 May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:29:37.340385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31125b05c5e54ea28bac344b98366385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31125b05c5e54ea28bac344b98366385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31125b05c5e54ea28bac344b98366385"}]}] May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-VolumesNegativeTest-387055832 May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 31125b05c5e54ea28bac344b98366385 May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-VolumesNegativeTest-387055832 May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-VolumesNegativeTest-387055832-project May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: a2228dffa3514c39bee2f7c2f41fbc60 May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-VolumesNegativeTest-387055832-project May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Volume d268ec08-c6c8-4b38-8ac9-d733f6851436 could not be found. May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'd268ec08-c6c8-4b38-8ac9-d733f6851436'} May 09 18:29:37.341710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d268ec08-c6c8-4b38-8ac9-d733f6851436 could not be found. (HTTP 404) (Request-ID: req-977a2320-1175-40b3-8a39-3ea026f71dea) May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:37.342529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:37.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d268ec08-c6c8-4b38-8ac9-d733f6851436 could not be found. May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:29:37.345418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d268ec08-c6c8-4b38-8ac9-d733f6851436 could not be found. May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d268ec08-c6c8-4b38-8ac9-d733f6851436 could not be found. May 09 18:29:37.346607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:37.349423 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bfd2d0db-e8e7-46fd-bd8d-9854f8ce1a12 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] Returning 404 to user: Volume d268ec08-c6c8-4b38-8ac9-d733f6851436 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:37.351005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bfd2d0db-e8e7-46fd-bd8d-9854f8ce1a12 tempest-VolumesNegativeTest-387055832 tempest-VolumesNegativeTest-387055832-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d268ec08-c6c8-4b38-8ac9-d733f6851436" status: 404 len: 109 microversion: 2.1 time: 0.072478 May 09 18:29:37.351878 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:37 2022] GET /compute/v2.1/os-volumes/d268ec08-c6c8-4b38-8ac9-d733f6851436 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:29:38.205388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-30e13ac1-2ce2-4f0d-a0d0-ac5bd0181445 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f806171f0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:38.315405 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-30e13ac1-2ce2-4f0d-a0d0-ac5bd0181445 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc" status: 200 len: 346 microversion: 2.1 time: 0.116894 May 09 18:29:38.319498 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 7/11] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:38 2022] GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:38.333942 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5b39024b-aa0b-4ee1-aca0-a0dc47f8559c tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Action: 'create', calling method: .version_select at 0x7f3f80617820>, body: {"snapshot": {"volume_id": "daa4a0df-43d3-4824-9205-704ebb7502bc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2078761213"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:38.730759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5b39024b-aa0b-4ee1-aca0-a0dc47f8559c tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.403994 May 09 18:29:38.736693 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 8/12] 10.222.0.25 () {60 vars in 1161 bytes} [Mon May 9 18:29:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:29:38.742311 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-66dea4fa-f4a7-4500-aaca-44aa4519d809 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f8062b0d0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:38.794306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-66dea4fa-f4a7-4500-aaca-44aa4519d809 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 200 len: 287 microversion: 2.1 time: 0.055372 May 09 18:29:38.794306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 9/13] 10.222.0.25 () {58 vars in 1250 bytes} [Mon May 9 18:29:38 2022] GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:29:38.816705 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1bf16a22-03bc-4de6-9927-1fe355980449 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f80926d30>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:38.895915 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1bf16a22-03bc-4de6-9927-1fe355980449 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.084305 May 09 18:29:38.896863 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 10/14] 10.222.0.25 () {58 vars in 1139 bytes} [Mon May 9 18:29:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:38.909608 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fd1beb0b-db53-4da3-ba55-f4d4ccecc184 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f806361f0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:39.063062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fd1beb0b-db53-4da3-ba55-f4d4ccecc184 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 200 len: 287 microversion: 2.1 time: 0.157161 May 09 18:29:39.066068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 11/15] 10.222.0.25 () {58 vars in 1250 bytes} [Mon May 9 18:29:38 2022] GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:29:39.373375 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:29:39.375378 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:29:39.376301 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:29:39.376962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:29:39.377920 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:29:39.409017 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:39.412146 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:39.413276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:39.413929 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:39.485487 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Getting quotas for project 3e0d940b1aea46aea0fa187448375f04. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:29:39.503717 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Getting quotas for user 3312802ff729418f90e6f25e6faf0ee0 and project 3e0d940b1aea46aea0fa187448375f04. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:29:39.537283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:29:39.541001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:29:39.716984 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-46048b1c-8ee0-4f9a-bedb-77a7014056c1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.363457 May 09 18:29:39.718431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 5/16] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:29:39.728811 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-830b9961-aee8-4c25-b6e0-9f1ab6c511b4 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:39.729776 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-830b9961-aee8-4c25-b6e0-9f1ab6c511b4 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:39.990044 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-830b9961-aee8-4c25-b6e0-9f1ab6c511b4 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:40.008665 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-830b9961-aee8-4c25-b6e0-9f1ab6c511b4 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1214 microversion: 2.1 time: 0.283978 May 09 18:29:40.025673 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 12/17] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:39 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:40.083937 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8a1d3dc1-ac9d-4d35-8105-b33925457cfa tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f7fcb53a0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:40.193288 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8a1d3dc1-ac9d-4d35-8105-b33925457cfa tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 200 len: 287 microversion: 2.1 time: 0.119460 May 09 18:29:40.197709 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 6/18] 10.222.0.25 () {58 vars in 1250 bytes} [Mon May 9 18:29:40 2022] GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:41.041770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-13c50e0a-997e-42c9-ae19-9afee0e375ca tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:41.042393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-13c50e0a-997e-42c9-ae19-9afee0e375ca tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:41.206023 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fe0fee5b-ca10-4ec5-a9d5-2b1c3089fa68 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f7fcb5af0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:41.276343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fe0fee5b-ca10-4ec5-a9d5-2b1c3089fa68 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 200 len: 287 microversion: 2.1 time: 0.075301 May 09 18:29:41.277159 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 7/19] 10.222.0.25 () {58 vars in 1250 bytes} [Mon May 9 18:29:41 2022] GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:41.336481 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-13c50e0a-997e-42c9-ae19-9afee0e375ca tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:41.344346 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-13c50e0a-997e-42c9-ae19-9afee0e375ca tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1214 microversion: 2.1 time: 0.306940 May 09 18:29:41.344925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 13/20] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:41 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:42.287609 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e055dc60-d8ef-497d-817d-9361e3fd999e tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f7fcb5ee0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:42.329331 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e055dc60-d8ef-497d-817d-9361e3fd999e tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 200 len: 288 microversion: 2.1 time: 0.045496 May 09 18:29:42.329904 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 8/21] 10.222.0.25 () {58 vars in 1250 bytes} [Mon May 9 18:29:42 2022] GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:42.344307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1b73d990-9751-40ec-93c6-5cc2bfe71888 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f805dcaf0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:42.361790 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:42.362418 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:42.398807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:42.404800 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:42.409270 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:42.410180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:42.512122 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1b73d990-9751-40ec-93c6-5cc2bfe71888 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 202 len: 0 microversion: 2.1 time: 0.175501 May 09 18:29:42.512841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 14/22] 10.222.0.25 () {58 vars in 1253 bytes} [Mon May 9 18:29:42 2022] DELETE /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:29:42.521622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-203a2e34-4810-4ae3-9182-3c088281d0f3 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f8056a310>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:42.610088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-203a2e34-4810-4ae3-9182-3c088281d0f3 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 200 len: 287 microversion: 2.1 time: 0.091826 May 09 18:29:42.612231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 15/23] 10.222.0.25 () {58 vars in 1250 bytes} [Mon May 9 18:29:42 2022] GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:43.126433 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:43.150247 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-75229d1b-2db7-4340-b305-ef00b5a3fffd tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1210 microversion: 2.1 time: 0.792727 May 09 18:29:43.158222 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 9/24] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:42 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1210 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:43.631677 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1a9b6014-cf44-4a3a-bc3c-0bdb230268ca tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f805dc820>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:43.673631 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-1a9b6014-cf44-4a3a-bc3c-0bdb230268ca tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] HTTP exception thrown: Snapshot 86bcf3e9-af63-4d0f-9aff-e4294c49fe71 could not be found. May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1a9b6014-cf44-4a3a-bc3c-0bdb230268ca tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Request method failure captured: May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 HTTP/1.1 May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2N3xt_uT1dJUK2PzANtKxKU8ZUb7_ZaLCY5qohYDmoEfY2SNGDQt3ONzeWhjD9SxJIvCG8tPu4Vvai0wWIlvi0n9koNUfhVP7ghMuG0fz7m_bKT86Y-QN8TkLnQmCiOZ9vIFJn2tRZLm4-4FPBowRA-cfUSVSNaHfzPXNcYwFx_Ag May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:29:43.676055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74dc3d60f0bc4ceb85d32720240c4032"}]}] May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 9e73b40a50c1493bbee6142044605826 May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Snapshot 86bcf3e9-af63-4d0f-9aff-e4294c49fe71 could not be found. May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '86bcf3e9-af63-4d0f-9aff-e4294c49fe71'} May 09 18:29:43.677107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 86bcf3e9-af63-4d0f-9aff-e4294c49fe71 could not be found. (HTTP 404) (Request-ID: req-c508867f-a854-45b8-bbcd-0de762a96b04) May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:43.677760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:43.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 86bcf3e9-af63-4d0f-9aff-e4294c49fe71 could not be found. May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 09 18:29:43.679593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 86bcf3e9-af63-4d0f-9aff-e4294c49fe71 could not be found. May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 86bcf3e9-af63-4d0f-9aff-e4294c49fe71 could not be found. May 09 18:29:43.681727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:43.683877 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1a9b6014-cf44-4a3a-bc3c-0bdb230268ca tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Returning 404 to user: Snapshot 86bcf3e9-af63-4d0f-9aff-e4294c49fe71 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:43.685684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1a9b6014-cf44-4a3a-bc3c-0bdb230268ca tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71" status: 404 len: 111 microversion: 2.1 time: 0.065251 May 09 18:29:43.686852 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 16/25] 10.222.0.25 () {58 vars in 1250 bytes} [Mon May 9 18:29:43 2022] GET /compute/v2.1/os-snapshots/86bcf3e9-af63-4d0f-9aff-e4294c49fe71 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:29:43.695770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-41317426-7c5d-4cbe-9195-0160e76d6ab4 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f7f4499d0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:43.917843 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-41317426-7c5d-4cbe-9195-0160e76d6ab4 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc" status: 202 len: 0 microversion: 2.1 time: 0.226660 May 09 18:29:43.920954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 10/26] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:29:43 2022] DELETE /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:29:43.930983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7d74fc37-6cae-452f-be5b-37f1250aefdf tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f80617670>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:44.054025 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7d74fc37-6cae-452f-be5b-37f1250aefdf tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc" status: 200 len: 345 microversion: 2.1 time: 0.128569 May 09 18:29:44.059052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 17/27] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:43 2022] GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:44.172380 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:44.173391 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:44.181942 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:44.183338 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:44.190415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:44.196639 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:44.534848 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:44.544542 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-37bf36a4-b66b-4b98-9b00-43e9bd589011 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1272 microversion: 2.1 time: 0.377785 May 09 18:29:44.547590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 11/28] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:44 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1272 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:45.068047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-68f9127b-abad-4f08-9aa4-81d95055d182 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f80b8be50>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:45.125161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-68f9127b-abad-4f08-9aa4-81d95055d182 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] HTTP exception thrown: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-68f9127b-abad-4f08-9aa4-81d95055d182 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Request method failure captured: May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc HTTP/1.1 May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2N3xt_uT1dJUK2PzANtKxKU8ZUb7_ZaLCY5qohYDmoEfY2SNGDQt3ONzeWhjD9SxJIvCG8tPu4Vvai0wWIlvi0n9koNUfhVP7ghMuG0fz7m_bKT86Y-QN8TkLnQmCiOZ9vIFJn2tRZLm4-4FPBowRA-cfUSVSNaHfzPXNcYwFx_Ag May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:29:45.127169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74dc3d60f0bc4ceb85d32720240c4032"}]}] May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 9e73b40a50c1493bbee6142044605826 May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'daa4a0df-43d3-4824-9205-704ebb7502bc'} May 09 18:29:45.128552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. (HTTP 404) (Request-ID: req-1b485ccc-b094-4fbf-b1c5-f230ef532a22) May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.129241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:45.130652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:29:45.131576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-68f9127b-abad-4f08-9aa4-81d95055d182 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Returning 404 to user: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-68f9127b-abad-4f08-9aa4-81d95055d182 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc" status: 404 len: 109 microversion: 2.1 time: 0.067134 May 09 18:29:45.132446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 18/29] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:45 2022] GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:29:45.142388 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-77450f48-2c46-43c8-ab04-1a0e58f4518a tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f7f407c10>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:45.196098 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-77450f48-2c46-43c8-ab04-1a0e58f4518a tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] HTTP exception thrown: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-77450f48-2c46-43c8-ab04-1a0e58f4518a tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Request method failure captured: May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: DELETE /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc HTTP/1.1 May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2N3xt_uT1dJUK2PzANtKxKU8ZUb7_ZaLCY5qohYDmoEfY2SNGDQt3ONzeWhjD9SxJIvCG8tPu4Vvai0wWIlvi0n9koNUfhVP7ghMuG0fz7m_bKT86Y-QN8TkLnQmCiOZ9vIFJn2tRZLm4-4FPBowRA-cfUSVSNaHfzPXNcYwFx_Ag May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:29:45.199566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74dc3d60f0bc4ceb85d32720240c4032"}]}] May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 9e73b40a50c1493bbee6142044605826 May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'daa4a0df-43d3-4824-9205-704ebb7502bc'} May 09 18:29:45.200647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. (HTTP 404) (Request-ID: req-0932726b-2a5d-41bb-bbd7-0b103529a670) May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.201243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 18:29:45.202125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 18:29:45.203008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:29:45.205591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-77450f48-2c46-43c8-ab04-1a0e58f4518a tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Returning 404 to user: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:45.207919 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-77450f48-2c46-43c8-ab04-1a0e58f4518a tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc" status: 404 len: 109 microversion: 2.1 time: 0.066568 May 09 18:29:45.208560 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 12/30] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:29:45 2022] DELETE /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:29:45.219693 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a8939a34-6768-4c69-823d-0dabd07d26c4 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Calling method '.version_select at 0x7f3f8056a4c0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:45.291141 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-a8939a34-6768-4c69-823d-0dabd07d26c4 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] HTTP exception thrown: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a8939a34-6768-4c69-823d-0dabd07d26c4 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Request method failure captured: May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc HTTP/1.1 May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2N3xt_uT1dJUK2PzANtKxKU8ZUb7_ZaLCY5qohYDmoEfY2SNGDQt3ONzeWhjD9SxJIvCG8tPu4Vvai0wWIlvi0n9koNUfhVP7ghMuG0fz7m_bKT86Y-QN8TkLnQmCiOZ9vIFJn2tRZLm4-4FPBowRA-cfUSVSNaHfzPXNcYwFx_Ag May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:29:45.295595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74dc3d60f0bc4ceb85d32720240c4032"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74dc3d60f0bc4ceb85d32720240c4032"}]}] May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 74dc3d60f0bc4ceb85d32720240c4032 May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1380527016 May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 9e73b40a50c1493bbee6142044605826 May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1380527016-project May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'daa4a0df-43d3-4824-9205-704ebb7502bc'} May 09 18:29:45.297773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. (HTTP 404) (Request-ID: req-01d2fb39-48d0-4e03-9b8f-6fc0de5a027b) May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.299339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:29:45.300648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:29:45.302062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. May 09 18:29:45.303411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:29:45.306329 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a8939a34-6768-4c69-823d-0dabd07d26c4 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] Returning 404 to user: Volume daa4a0df-43d3-4824-9205-704ebb7502bc could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:29:45.310853 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a8939a34-6768-4c69-823d-0dabd07d26c4 tempest-VolumesSnapshotsTestJSON-1380527016 tempest-VolumesSnapshotsTestJSON-1380527016-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc" status: 404 len: 109 microversion: 2.1 time: 0.096895 May 09 18:29:45.311828 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 19/31] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:45 2022] GET /compute/v2.1/os-volumes/daa4a0df-43d3-4824-9205-704ebb7502bc => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:29:45.567807 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:45.568465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:45.583438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:45.586408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:45.590478 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:45.592505 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:46.294116 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-42a44051-31ce-44be-9aa0-07dcc7b30682 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: .version_select at 0x7f3f8060f820>, body: {"keypair": {"name": "tempest-keypair-1719882760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTG3t2Ih36yEW7CudkaMjwBPNk525DRpu2wjiOX8XenNwsKFybJk5TKASo2VzVq5wDzhjSwamFalGg7umdyjhHBvaZfCPIysj9RQmHWiBho+Hp0priLd4/eUCgfSG0TRg=="}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:46.379017 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-42a44051-31ce-44be-9aa0-07dcc7b30682 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:29:46.393742 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-42a44051-31ce-44be-9aa0-07dcc7b30682 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:29:46.480886 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-42a44051-31ce-44be-9aa0-07dcc7b30682 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.153777 May 09 18:29:46.490382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 13/32] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:29:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:47.107648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:47.163798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b74511b3-d725-4f6b-a910-20fd4b0fb6b6 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1272 microversion: 2.1 time: 1.599494 May 09 18:29:47.180931 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 20/33] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:45 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1272 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:48.184728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:48.185978 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:48.205704 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:48.210570 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:48.211727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:48.215852 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:50.738975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:50.796822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-22e060ce-aafc-4468-8e19-c3290b188176 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 2.614902 May 09 18:29:50.797653 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 14/34] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:48 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 2618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:51.816791 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:51.818295 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:51.829756 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:51.832799 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:51.835099 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:51.835898 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:52.412734 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:52.426015 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9753242b-b0fe-4051-bd65-20fd1f3dc056 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.615191 May 09 18:29:52.436927 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 21/35] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:51 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:53.452961 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:53.459213 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:53.481093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:53.481557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:53.482352 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:53.488871 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:53.978935 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-155d4dd3-f745-4a26-8255-11a6d4f32d89 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'create', calling method: .version_select at 0x7f3f7f3b79d0>, body: {"keypair": {"name": "tempest-keypair-1224619962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtrRcShR2MEu/VPGWcz1LOIiem869b/LV5AMMVNZH7xAeGjWxdV0JdxV6/g/7ckbJfd3Nsp+8gcQ/fmg4VcALHf61/RwZK8qwj9OGaX85eD2S81NBlKmape0MZp+BCHbg=="}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:54.028124 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-155d4dd3-f745-4a26-8255-11a6d4f32d89 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for project 78039fb4f0bd454b8aea3db748343263. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:29:54.037035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-155d4dd3-f745-4a26-8255-11a6d4f32d89 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for user 90fdc96d6e6649a498bb3a8659fcc030 and project 78039fb4f0bd454b8aea3db748343263. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:29:54.116232 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-155d4dd3-f745-4a26-8255-11a6d4f32d89 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.907569 May 09 18:29:54.118352 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 15/36] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:29:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:54.319099 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9ef508df-76b3-49fd-a97c-1628dce2911d tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7f3d48b0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:54.489913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9ef508df-76b3-49fd-a97c-1628dce2911d tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4035b9ed-f1d2-4623-87f8-b1045c308b7e" status: 200 len: 350 microversion: 2.1 time: 0.176380 May 09 18:29:54.497624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 16/37] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:54 2022] GET /compute/v2.1/os-volumes/4035b9ed-f1d2-4623-87f8-b1045c308b7e => generated 350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:54.981419 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:55.002981 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ca01fb33-2407-4702-b7b0-41ad9288f50d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 1.558385 May 09 18:29:55.024139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 22/38] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:53 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:56.036197 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:56.037565 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:29:56.050112 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:56.053843 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:56.067402 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:56.068818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:56.390163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-154d84ee-ac75-4a9c-8e9c-4d6305609d93 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f80512ca0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:29:56.589495 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-154d84ee-ac75-4a9c-8e9c-4d6305609d93 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c8499241-0b5b-4eec-a2ef-48c9f29bb69b" status: 200 len: 350 microversion: 2.1 time: 0.204881 May 09 18:29:56.590721 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 23/39] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:29:56 2022] GET /compute/v2.1/os-volumes/c8499241-0b5b-4eec-a2ef-48c9f29bb69b => generated 350 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:29:56.664696 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:29:56.683660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8741a494-0842-4708-a205-104862032d66 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.662311 May 09 18:29:56.699952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 17/40] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:29:56 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:29:57.228334 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-881817136", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "301e94ce-a989-4fe3-9992-0fa06fbc5e5e"}], "security_groups": [{"name": "tempest-securitygroup--122172466"}], "key_name": "tempest-keypair-1719882760", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:58.034547 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-657080848", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:29:58.166643 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] validate_networks() for [('301e94ce-a989-4fe3-9992-0fa06fbc5e5e', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:29:58.169449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] validate_networks() for [('6bd4c030-c4c5-476b-9935-9aed7888eb95', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:29:59.809050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:29:59.809827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:29:59.810433 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:29:59.811088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:29:59.812569 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:29:59.825519 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:59.826235 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:59.828261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:29:59.828945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:29:59.853293 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:29:59.858741 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for user acae3ad19a7e45b9877520dff8f5b995 and project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:29:59.881677 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:29:59.884374 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:30:00.020840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f10188eb-5536-402b-9b2d-0c2210ca1b24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.692246 May 09 18:30:00.023754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 18/41] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:29:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:30:00.034557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:00.037869 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:00.057696 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:00.060317 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:00.062141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:00.069351 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:00.443662 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:30:00.445325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:30:00.446062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:30:00.446826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:30:00.447996 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:30:00.480791 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:00.484141 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:00.486674 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:00.491856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:00.622969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:30:00.644923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:30:00.660279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:00.682141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bf490472-a70f-4552-ab74-1fa1cf7fb5d1 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.647334 May 09 18:30:00.690662 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:30:00.700449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 19/42] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:00 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:00.700660 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:30:00.938959 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-688d1e38-07ca-4162-8c53-5f8613d75e0f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.732136 May 09 18:30:00.944713 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 24/43] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:29:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 3734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:30:00.946432 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-51637f7e-c12d-40e4-b569-4a8ef86b82fb tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f80401ca0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:01.137551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-51637f7e-c12d-40e4-b569-4a8ef86b82fb tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eb03cc9f-314a-4f02-9e16-9eb6308479ac" status: 200 len: 351 microversion: 2.1 time: 0.196301 May 09 18:30:01.138621 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 25/44] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:30:00 2022] GET /compute/v2.1/os-volumes/eb03cc9f-314a-4f02-9e16-9eb6308479ac => generated 351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:01.144630 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-97818a1b-c1d2-441c-affb-f925941a10ec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:01.147100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-97818a1b-c1d2-441c-affb-f925941a10ec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:01.189731 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-73c9aff9-89ef-4015-bf01-8ca2e260da3d req-7ee8b04f-e66a-41ed-9359-1f717f131e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1074019a-07cc-4aea-8385-4803e00e1d7b", "tag": "5e0cd009-d38e-452c-a4c4-7736e46f139b"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:01.223332 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-73c9aff9-89ef-4015-bf01-8ca2e260da3d req-7ee8b04f-e66a-41ed-9359-1f717f131e4f service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:01.243363 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-73c9aff9-89ef-4015-bf01-8ca2e260da3d req-7ee8b04f-e66a-41ed-9359-1f717f131e4f service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:01.292142 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-97818a1b-c1d2-441c-affb-f925941a10ec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:01.298731 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-97818a1b-c1d2-441c-affb-f925941a10ec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1221 microversion: 2.1 time: 0.158347 May 09 18:30:01.319976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-73c9aff9-89ef-4015-bf01-8ca2e260da3d req-7ee8b04f-e66a-41ed-9359-1f717f131e4f service nova] Creating event network-changed:5e0cd009-d38e-452c-a4c4-7736e46f139b for instance 1074019a-07cc-4aea-8385-4803e00e1d7b on hv-cinder-84112 May 09 18:30:01.320465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-73c9aff9-89ef-4015-bf01-8ca2e260da3d req-7ee8b04f-e66a-41ed-9359-1f717f131e4f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 18:30:01.321618 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-207b4d6b-e332-42f2-9c8a-c80337c28dbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:01.334568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-207b4d6b-e332-42f2-9c8a-c80337c28dbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:01.335630 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-207b4d6b-e332-42f2-9c8a-c80337c28dbc None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:01.336053 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-207b4d6b-e332-42f2-9c8a-c80337c28dbc None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:01.347589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 26/45] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:01 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:01.372168 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1000014529", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4730889d-2bd2-49e5-82ef-67b5eb3e8023"}], "security_groups": [{"name": "tempest-securitygroup--2041808245"}], "key_name": "tempest-keypair-1224619962", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:01.392757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.compute.rpcapi [None req-207b4d6b-e332-42f2-9c8a-c80337c28dbc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 18:30:01.393707 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-207b4d6b-e332-42f2-9c8a-c80337c28dbc None None] Releasing lock "compute-rpcapi-router" {{(pid=117088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 18:30:01.474461 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-207b4d6b-e332-42f2-9c8a-c80337c28dbc None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.781126 May 09 18:30:01.475602 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 20/46] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:01.494969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c9268868-ef36-4e65-9bbe-54516166f6c2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:01.496026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c9268868-ef36-4e65-9bbe-54516166f6c2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:01.826036 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c9268868-ef36-4e65-9bbe-54516166f6c2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:01.884774 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c9268868-ef36-4e65-9bbe-54516166f6c2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1241 microversion: 2.1 time: 0.402919 May 09 18:30:01.906740 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 21/47] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:01 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1241 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:01.936112 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-77383b82-6fd6-4215-9680-4c45eece03bf tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7f3dee50>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:02.033783 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] validate_networks() for [('4730889d-2bd2-49e5-82ef-67b5eb3e8023', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:30:02.247760 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-77383b82-6fd6-4215-9680-4c45eece03bf tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.339803 May 09 18:30:02.249365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 22/48] 10.222.0.25 () {58 vars in 1133 bytes} [Mon May 9 18:30:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:02.258726 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1471735782", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:02.417960 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] validate_networks() for [('6bd4c030-c4c5-476b-9935-9aed7888eb95', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:30:04.142488 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:30:04.144033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:30:04.144993 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:30:04.145879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:30:04.146335 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:30:04.180360 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.184115 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.188876 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.189564 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.208685 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:30:04.209738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:30:04.210393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:30:04.210968 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:30:04.211575 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:30:04.221969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.222438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.231453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.231930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.240890 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for project 78039fb4f0bd454b8aea3db748343263. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:30:04.250923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for user 90fdc96d6e6649a498bb3a8659fcc030 and project 78039fb4f0bd454b8aea3db748343263. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:30:04.295770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:30:04.300136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:30:04.304912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for user acae3ad19a7e45b9877520dff8f5b995 and project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:30:04.308718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:30:04.333298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:30:04.354467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:30:04.388613 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a6a32f01-8b22-4a4e-afeb-fd49bf339e04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.041450 May 09 18:30:04.391968 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 27/49] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:30:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 3045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:30:04.409585 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:04.410006 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:04.442998 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.443645 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.445398 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.447130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.504483 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9c5132f2-d460-49bd-9589-8ce69e9b6bb1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.254151 May 09 18:30:04.511960 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 23/50] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:30:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:30:04.518133 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-66b7117a-92ff-43c8-97cf-327c153107ff tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7f3de040>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:04.718687 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-66b7117a-92ff-43c8-97cf-327c153107ff tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.205042 May 09 18:30:04.719562 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 24/51] 10.222.0.25 () {58 vars in 1148 bytes} [Mon May 9 18:30:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:04.724103 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:04.728467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:04.739292 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.742709 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.744801 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:04.746802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:04.789216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:04.818783 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5d4e89ab-84c1-4a38-bbfd-458bf958d81e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.418147 May 09 18:30:04.821864 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 28/52] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:04 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:04.829469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-21b2ab38-02b7-4fff-bde7-6c83ed1290d3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:04.865079 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-21b2ab38-02b7-4fff-bde7-6c83ed1290d3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:04.947120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:04.961426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-babdf0b7-3ef7-444d-90fc-7f8b01bb5f86 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1299 microversion: 2.1 time: 0.238067 May 09 18:30:04.962769 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 25/53] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:04 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1299 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:04.974860 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5703464c-3599-45d3-884f-53caa6f50a86 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:04.976368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5703464c-3599-45d3-884f-53caa6f50a86 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:05.046337 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-21b2ab38-02b7-4fff-bde7-6c83ed1290d3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:05.065832 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-21b2ab38-02b7-4fff-bde7-6c83ed1290d3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1238 microversion: 2.1 time: 0.241728 May 09 18:30:05.079159 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 29/54] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:04 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1238 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:05.088354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bb3dfb9d-59ce-4ac3-aca3-dfeaf5c0ea4e tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f8041d820>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:05.167168 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5703464c-3599-45d3-884f-53caa6f50a86 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:05.180188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5703464c-3599-45d3-884f-53caa6f50a86 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1222 microversion: 2.1 time: 0.214316 May 09 18:30:05.181917 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 26/55] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:04 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:05.316792 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bb3dfb9d-59ce-4ac3-aca3-dfeaf5c0ea4e tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.236060 May 09 18:30:05.317364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 30/56] 10.222.0.25 () {58 vars in 1133 bytes} [Mon May 9 18:30:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:05.329339 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-31da3d0a-8f91-426a-88a6-eb854f669aaf tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7f39f280>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:05.424815 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-31da3d0a-8f91-426a-88a6-eb854f669aaf tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099755 May 09 18:30:05.427230 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 27/57] 10.222.0.25 () {58 vars in 1166 bytes} [Mon May 9 18:30:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:05.437422 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-03896d4d-7557-48b0-a0bd-ba650cf9b077 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7f3b3550>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:05.577013 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-03896d4d-7557-48b0-a0bd-ba650cf9b077 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.137971 May 09 18:30:05.583042 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 31/58] 10.222.0.25 () {58 vars in 1169 bytes} [Mon May 9 18:30:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:05.594884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-54be56da-e5d6-41ea-9fd6-383a448a5d2d tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7eb7be50>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:05.838435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:05.839072 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:05.860350 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:05.862039 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:05.867102 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-54be56da-e5d6-41ea-9fd6-383a448a5d2d tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.276605 May 09 18:30:05.867803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 28/59] 10.222.0.25 () {58 vars in 1154 bytes} [Mon May 9 18:30:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:05.872200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:05.881038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-acabcde1-3a35-4dc5-9f1a-08158a3c8a69 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7eb7ba60>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:05.883903 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:06.165466 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-acabcde1-3a35-4dc5-9f1a-08158a3c8a69 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.289742 May 09 18:30:06.166531 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 29/60] 10.222.0.25 () {58 vars in 1187 bytes} [Mon May 9 18:30:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:06.174275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:06.175123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:06.194315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:06.194720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:06.195692 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:06.196313 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:06.234910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:06.257993 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f78508d7-ed01-40df-84b5-c7a67ae47a68 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.423286 May 09 18:30:06.259030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 32/61] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:05 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:06.273524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:06.276764 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:06.294599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:06.296994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:06.298310 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:06.299532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:06.413024 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:06.429222 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ed347283-ec02-449a-902f-0f084d30240b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1299 microversion: 2.1 time: 0.258204 May 09 18:30:06.430337 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 30/62] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:06 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:06.442291 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b85ccc84-af78-4ec7-ac64-fabbf4c06452 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] Calling method '.version_select at 0x7f3f7eb7b1f0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:06.505703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:06.518345 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a914921b-8c7e-47d3-868a-99d112cd3262 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1290 microversion: 2.1 time: 0.257836 May 09 18:30:06.519322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 33/63] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:06 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1290 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:06.542310 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:06.548420 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:06.576064 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:06.577961 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:06.579353 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:06.581649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:06.723942 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b85ccc84-af78-4ec7-ac64-fabbf4c06452 tempest-VolumesTestJSON-1041462422 tempest-VolumesTestJSON-1041462422-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.290215 May 09 18:30:06.724532 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 31/64] 10.222.0.25 () {58 vars in 1154 bytes} [Mon May 9 18:30:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:06.978862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:06.994741 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b17a57b7-3bb1-4d0f-a2d6-90f1586b7e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1282 microversion: 2.1 time: 0.468226 May 09 18:30:06.996756 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 34/65] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:06 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1282 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:07.279106 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:07.280393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:07.289219 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:07.289691 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:07.291547 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:07.294212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:07.449159 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:07.451097 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:07.459310 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:07.459621 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:07.460432 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:07.460887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:07.830517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:07.838693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8624a107-3336-4d7a-892f-9f46d3e22a7c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.565517 May 09 18:30:07.841560 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:07 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:07.855786 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:07.857526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:07.869770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:07.883436 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:07.884602 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:07.885223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:08.197863 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:08.212721 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e13fb55b-b9a3-4625-9ebd-4b38e325948c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1296 microversion: 2.1 time: 0.365923 May 09 18:30:08.214185 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 33/67] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:07 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1296 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:08.229979 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:08.244016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:08.258934 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:08.259611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:08.262375 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:08.263100 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:08.375310 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:08.384734 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-07828bf1-1568-4295-bc12-8fcbee764c1e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.941282 May 09 18:30:08.389446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 35/68] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:07 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:08.414114 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:08.441220 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c00e1125-ecaa-4bff-96e8-02312e109bc2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1280 microversion: 2.1 time: 0.223831 May 09 18:30:08.456692 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:08 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:08.862254 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:08.863281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:08.875579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:08.879051 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:08.880150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:08.882203 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:09.268302 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-14e8159c-30ab-445a-9249-b86f7fb76997 req-d1c3e75f-fcf0-43ba-88dc-180f39856d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1074019a-07cc-4aea-8385-4803e00e1d7b", "name": "network-vif-plugged", "status": "completed", "tag": "5e0cd009-d38e-452c-a4c4-7736e46f139b"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:09.284501 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-14e8159c-30ab-445a-9249-b86f7fb76997 req-d1c3e75f-fcf0-43ba-88dc-180f39856d48 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:09.294986 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-14e8159c-30ab-445a-9249-b86f7fb76997 req-d1c3e75f-fcf0-43ba-88dc-180f39856d48 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:09.315092 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-14e8159c-30ab-445a-9249-b86f7fb76997 req-d1c3e75f-fcf0-43ba-88dc-180f39856d48 service nova] Creating event network-vif-plugged:5e0cd009-d38e-452c-a4c4-7736e46f139b for instance 1074019a-07cc-4aea-8385-4803e00e1d7b on hv-cinder-84112 May 09 18:30:09.348203 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-14e8159c-30ab-445a-9249-b86f7fb76997 req-d1c3e75f-fcf0-43ba-88dc-180f39856d48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365530 May 09 18:30:09.349326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 35/70] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:09.355537 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:09.356466 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:09.372700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:09.379605 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:09.382254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:09.386207 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:09.711900 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:09.723229 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-071a02c2-066f-4deb-b0d9-752b4f04630b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1296 microversion: 2.1 time: 0.372382 May 09 18:30:09.725998 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 36/71] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:09 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1296 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:09.740887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:09.741880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:09.760778 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:09.762625 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:09.763463 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:09.764545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:10.018171 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:10.028626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2ca7bef1-20c5-48b8-a454-7b7299c29de8 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 1.172979 May 09 18:30:10.030612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 36/72] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:08 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:10.038699 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:10.040044 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:10.059087 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:10.062150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:10.064210 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:10.064942 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:10.212906 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:10.224254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b1b54589-a17e-46e9-9b8d-b3426cba7cdd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.495741 May 09 18:30:10.225068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:10.235825 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 37/73] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:09 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:10.253693 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-168ed8d9-c5c3-402c-8894-5cdfbb6a4af4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1280 microversion: 2.1 time: 0.219242 May 09 18:30:10.255950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 37/74] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:10 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:10.500955 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-967f32c2-e4f7-4927-9511-4c2b50e8f3db req-aeef6e45-99b1-43c2-a7de-6ca414e2a3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e67e009-eec8-48f1-b8ec-5ba755aeba51", "tag": "28dc9b59-8a04-48ce-a5d0-8f7894d1dc83"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:10.513053 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-967f32c2-e4f7-4927-9511-4c2b50e8f3db req-aeef6e45-99b1-43c2-a7de-6ca414e2a3a3 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:10.514855 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-967f32c2-e4f7-4927-9511-4c2b50e8f3db req-aeef6e45-99b1-43c2-a7de-6ca414e2a3a3 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:10.574514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-967f32c2-e4f7-4927-9511-4c2b50e8f3db req-aeef6e45-99b1-43c2-a7de-6ca414e2a3a3 service nova] Creating event network-changed:28dc9b59-8a04-48ce-a5d0-8f7894d1dc83 for instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 on hv-cinder-84112 May 09 18:30:10.595664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-967f32c2-e4f7-4927-9511-4c2b50e8f3db req-aeef6e45-99b1-43c2-a7de-6ca414e2a3a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352742 May 09 18:30:10.597094 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 38/75] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:10.753905 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:10.757332 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:10.765375 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:10.766197 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:10.767505 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:10.768639 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:11.047512 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:11.048489 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:11.070987 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:11.071477 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:11.072267 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:11.072703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:11.877103 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:11.885438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4d63f83f-2511-43de-b93b-ef093ae1ab39 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.842799 May 09 18:30:11.889574 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 39/76] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:11 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:11.894997 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:11.896206 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:11.897529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:11.906515 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-17513550-b837-4580-9604-392b55861777 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 1.166270 May 09 18:30:11.916693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:11.917375 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 38/77] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:10 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:11.920008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:11.921120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:11.921727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:11.944223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:11.947631 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:11.969611 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:11.970574 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:11.971592 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:11.977626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:12.534991 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:12.542707 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-944d054e-2991-4b93-a947-615b07fbef27 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.612506 May 09 18:30:12.544552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:11 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:12.587462 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:12.642228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2622b032-52eb-457f-82a2-095600be6b11 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.751352 May 09 18:30:12.645456 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 40/79] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:11 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:12.737271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-44c58b49-817b-4fff-b9d0-708653a40e5b req-6c84dc06-34cd-497e-ad28-ddcdb39537bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f", "tag": "97fbd8b0-83c4-4955-a743-dfced983ab62"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:12.792462 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-44c58b49-817b-4fff-b9d0-708653a40e5b req-6c84dc06-34cd-497e-ad28-ddcdb39537bb service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:12.793111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-44c58b49-817b-4fff-b9d0-708653a40e5b req-6c84dc06-34cd-497e-ad28-ddcdb39537bb service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:12.865796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-44c58b49-817b-4fff-b9d0-708653a40e5b req-6c84dc06-34cd-497e-ad28-ddcdb39537bb service nova] Creating event network-changed:97fbd8b0-83c4-4955-a743-dfced983ab62 for instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f on hv-cinder-84112 May 09 18:30:12.869905 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-44c58b49-817b-4fff-b9d0-708653a40e5b req-6c84dc06-34cd-497e-ad28-ddcdb39537bb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 18:30:12.873408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-080f2dc9-2287-4e59-8545-755437f98270 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:12.878763 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-080f2dc9-2287-4e59-8545-755437f98270 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:12.880508 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-080f2dc9-2287-4e59-8545-755437f98270 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:12.883913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-080f2dc9-2287-4e59-8545-755437f98270 None None] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:12.947048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:12.951632 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.compute.rpcapi [None req-080f2dc9-2287-4e59-8545-755437f98270 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 18:30:12.959168 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-080f2dc9-2287-4e59-8545-755437f98270 None None] Releasing lock "compute-rpcapi-router" {{(pid=117087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 18:30:12.988612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:13.039212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.039649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-080f2dc9-2287-4e59-8545-755437f98270 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.365824 May 09 18:30:13.039758 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.040581 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 40/80] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:13.042647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.043107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.049203 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:13.049931 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:13.103613 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.104073 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.105028 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.110226 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.544543 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:13.557766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-00df7edd-f03c-4204-95fc-7ba2dad2149e tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1314 microversion: 2.1 time: 0.652390 May 09 18:30:13.558352 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 41/81] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:12 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:13.567094 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-5339fceb-026f-415b-91d9-94072301e9b9 req-2b7abf18-6783-4781-950f-9390e4469a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a805d4-1420-4adb-a173-724abc1e9915", "tag": "1e18cb42-6fa5-49f6-8510-1b14aaa7fef4"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:13.589388 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-5339fceb-026f-415b-91d9-94072301e9b9 req-2b7abf18-6783-4781-950f-9390e4469a91 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.591380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:13.594522 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-5339fceb-026f-415b-91d9-94072301e9b9 req-2b7abf18-6783-4781-950f-9390e4469a91 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.601939 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b135d53a-7b3e-4667-8a9a-ea54e91bbf7d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.560085 May 09 18:30:13.604129 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:13 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:13.613891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-5339fceb-026f-415b-91d9-94072301e9b9 req-2b7abf18-6783-4781-950f-9390e4469a91 service nova] Creating event network-changed:1e18cb42-6fa5-49f6-8510-1b14aaa7fef4 for instance a7a805d4-1420-4adb-a173-724abc1e9915 on hv-cinder-84112 May 09 18:30:13.619792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-5339fceb-026f-415b-91d9-94072301e9b9 req-2b7abf18-6783-4781-950f-9390e4469a91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058656 May 09 18:30:13.629403 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 42/83] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:13.632435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:13.633360 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:13.643718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.644431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.645556 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.646007 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.662626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:13.663761 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:13.672914 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.673820 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.674940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:13.675508 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:13.858739 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:13.863393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:13.867430 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0ac1be5c-a821-449a-b613-e53f1b7d30eb tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.247281 May 09 18:30:13.868187 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 42/84] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:13 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:13.876913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4ed7a37e-2ead-414d-922e-e655b4fd6c1d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.212592 May 09 18:30:13.876913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 43/85] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:13 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:30:14.575091 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:14.575783 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:14.585669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:14.586132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:14.592599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:14.593137 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:14.622910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:14.629284 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:14.636491 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:14.637151 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:14.637897 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:14.639007 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:15.691239 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:15.699293 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8967e738-4256-40f8-8cd3-bdd439412e07 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 1.080657 May 09 18:30:15.700159 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 43/86] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:14 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:15.711703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:15.712621 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:15.720617 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:15.721249 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:15.722314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:15.722994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:15.779377 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:15.790142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9863d5fd-f5a7-4f3b-9f3d-d925f51380e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1500 microversion: 2.1 time: 1.219772 May 09 18:30:15.790771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 44/87] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:14 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1500 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:15.812744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:15.820860 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:15.827987 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:15.828667 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:15.831412 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:15.832141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:16.184032 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:16.198482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7b54186a-485f-4d89-944f-8162662764c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.497104 May 09 18:30:16.199061 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 44/88] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:15 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:16.213666 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:16.220164 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-15f57d2e-368c-40af-a057-b1ef10e72f7c req-2a120d4f-78e3-456d-a5b6-f3f0de87302c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f754ac61-c5df-4016-abe2-d0c01e946f0d", "tag": "4449e893-fb12-4e63-acd4-0431cb2533e9"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:16.234133 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6a7603ba-0033-4194-88ac-9ecaa56bcaab tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.428927 May 09 18:30:16.237057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-15f57d2e-368c-40af-a057-b1ef10e72f7c req-2a120d4f-78e3-456d-a5b6-f3f0de87302c service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:16.237899 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-15f57d2e-368c-40af-a057-b1ef10e72f7c req-2a120d4f-78e3-456d-a5b6-f3f0de87302c service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:16.245536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 45/89] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:15 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:16.262829 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-15f57d2e-368c-40af-a057-b1ef10e72f7c req-2a120d4f-78e3-456d-a5b6-f3f0de87302c service nova] Creating event network-changed:4449e893-fb12-4e63-acd4-0431cb2533e9 for instance f754ac61-c5df-4016-abe2-d0c01e946f0d on hv-cinder-84112 May 09 18:30:16.271282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-15f57d2e-368c-40af-a057-b1ef10e72f7c req-2a120d4f-78e3-456d-a5b6-f3f0de87302c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058152 May 09 18:30:16.272496 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 45/90] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:16.718970 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:16.720402 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:16.728713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:16.729438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:16.730653 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:16.731471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:17.000165 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-f22930a0-b1d2-4875-8925-85cefcae1de6 req-360ca26a-b4cd-4a24-811b-16179c59198c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e67e009-eec8-48f1-b8ec-5ba755aeba51", "name": "network-vif-plugged", "status": "completed", "tag": "28dc9b59-8a04-48ce-a5d0-8f7894d1dc83"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:17.038632 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f22930a0-b1d2-4875-8925-85cefcae1de6 req-360ca26a-b4cd-4a24-811b-16179c59198c service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:17.039104 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f22930a0-b1d2-4875-8925-85cefcae1de6 req-360ca26a-b4cd-4a24-811b-16179c59198c service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:17.069118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-f22930a0-b1d2-4875-8925-85cefcae1de6 req-360ca26a-b4cd-4a24-811b-16179c59198c service nova] Creating event network-vif-plugged:28dc9b59-8a04-48ce-a5d0-8f7894d1dc83 for instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 on hv-cinder-84112 May 09 18:30:17.083714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-f22930a0-b1d2-4875-8925-85cefcae1de6 req-360ca26a-b4cd-4a24-811b-16179c59198c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088281 May 09 18:30:17.086675 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 46/91] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:17.218380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:17.219781 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:17.236512 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:17.238990 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:17.241302 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:17.244136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:17.259876 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:17.271001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e94575de-b735-4ffa-b4eb-5db6a9f11b14 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.554687 May 09 18:30:17.271678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:16 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:17.286815 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:17.287482 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:17.320320 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:17.320837 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:17.323788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:17.326918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:17.717842 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:17.722656 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:17.728429 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-10366ec1-b337-47d2-995d-242c78da5692 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.513301 May 09 18:30:17.739223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-33087b00-9696-46f2-aec5-bfcc62ac25d5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.457304 May 09 18:30:17.739319 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 47/93] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:17 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:30:17.745771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 47/94] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:17 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:17.754765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fc45c236-ef90-4573-8690-5c903e24c79d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "137615f5-01a3-4912-8f2e-776b4f129523"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:17.763609 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fc45c236-ef90-4573-8690-5c903e24c79d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:17.774342 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fc45c236-ef90-4573-8690-5c903e24c79d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:17.774983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fc45c236-ef90-4573-8690-5c903e24c79d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:17.776158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fc45c236-ef90-4573-8690-5c903e24c79d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:17.776608 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fc45c236-ef90-4573-8690-5c903e24c79d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:18.289085 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:18.289709 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:18.297391 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:18.298143 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:18.299153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:18.299861 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:18.598399 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fc45c236-ef90-4573-8690-5c903e24c79d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "POST /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.861167 May 09 18:30:18.603601 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 48/95] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:30:17 2022] POST /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:18.695365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:18.705136 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b4fae559-c5fd-4d08-9dbd-d4a4d905b2ed tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.420968 May 09 18:30:18.706187 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 48/96] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:18 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:18.747022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:18.747861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:18.749603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:18.750226 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:18.760970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:18.761378 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:18.762169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:18.767661 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:18.768136 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:18.768939 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:18.770693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:18.771935 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:19.106634 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:19.117352 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e02602e4-56bd-40cb-a6ae-31a591811117 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.370678 May 09 18:30:19.118492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 49/97] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:18 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:19.125663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-55c8b196-7335-4be6-b686-0ba1925d752d req-50a794ee-83a6-4452-a65f-95c87246cd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f", "name": "network-vif-plugged", "status": "completed", "tag": "97fbd8b0-83c4-4955-a743-dfced983ab62"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:19.134819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:19.145566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3716cf63-7f21-491e-8a91-52eafcb79e76 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.399860 May 09 18:30:19.162528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:18 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:19.162622 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-55c8b196-7335-4be6-b686-0ba1925d752d req-50a794ee-83a6-4452-a65f-95c87246cd46 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:19.162622 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-55c8b196-7335-4be6-b686-0ba1925d752d req-50a794ee-83a6-4452-a65f-95c87246cd46 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:19.172588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-55c8b196-7335-4be6-b686-0ba1925d752d req-50a794ee-83a6-4452-a65f-95c87246cd46 service nova] Creating event network-vif-plugged:97fbd8b0-83c4-4955-a743-dfced983ab62 for instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f on hv-cinder-84112 May 09 18:30:19.187646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-55c8b196-7335-4be6-b686-0ba1925d752d req-50a794ee-83a6-4452-a65f-95c87246cd46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066905 May 09 18:30:19.192092 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 50/99] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:19.726552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:19.727501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:19.741124 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:19.741952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:19.743944 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:19.744548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:19.938610 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:19.948460 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d8827d4d-9ddf-4327-a110-87fa2ace046e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.227813 May 09 18:30:19.959709 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 50/100] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:19 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:20.137154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:20.138128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:20.147730 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:20.149206 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:20.153662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:20.154912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:20.178930 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:20.179742 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:20.195472 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:20.200658 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:20.202424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:20.204385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:20.640231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:20.652475 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-36ad1400-8d86-48b1-a57a-3e31f21f2f6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.478098 May 09 18:30:20.653357 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:20 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:30:20.657921 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:20.666178 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3ad18b9c-7825-44fd-886c-d1e62df318e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.533206 May 09 18:30:20.680399 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:20 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:20.969093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:20.970455 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:20.980953 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:20.981422 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:20.983999 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:20.984451 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:21.207545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-730b4dda-d48d-40ef-9cdd-884dd1322ead req-7ba074de-f45b-4d2a-8240-5305ddb9651d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f754ac61-c5df-4016-abe2-d0c01e946f0d", "name": "network-vif-plugged", "status": "completed", "tag": "4449e893-fb12-4e63-acd4-0431cb2533e9"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:21.219328 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-730b4dda-d48d-40ef-9cdd-884dd1322ead req-7ba074de-f45b-4d2a-8240-5305ddb9651d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:21.219802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-730b4dda-d48d-40ef-9cdd-884dd1322ead req-7ba074de-f45b-4d2a-8240-5305ddb9651d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:21.234886 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-730b4dda-d48d-40ef-9cdd-884dd1322ead req-7ba074de-f45b-4d2a-8240-5305ddb9651d service nova] Creating event network-vif-plugged:4449e893-fb12-4e63-acd4-0431cb2533e9 for instance f754ac61-c5df-4016-abe2-d0c01e946f0d on hv-cinder-84112 May 09 18:30:21.241080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-730b4dda-d48d-40ef-9cdd-884dd1322ead req-7ba074de-f45b-4d2a-8240-5305ddb9651d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037763 May 09 18:30:21.242221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 52/103] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:21.361403 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:21.375162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-312dd7c9-2564-4c25-bf20-48e228cae7aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.413157 May 09 18:30:21.376032 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:20 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:21.671208 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:21.672324 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:21.681823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:21.682926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:21.684568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:21.685792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:21.689131 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:21.689765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:21.708179 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:21.708886 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:21.709819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:21.710407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:22.071382 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:22.073273 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:22.083057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3d09f024-d14c-40a2-a5db-a8ebe46ebd56 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1366 microversion: 2.1 time: 0.398158 May 09 18:30:22.083558 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fc1af3b5-9009-4ce2-8125-2f308eba7870 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.416877 May 09 18:30:22.084720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 53/105] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:21 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:22.085226 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 53/106] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:21 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:30:22.392701 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:22.393325 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:22.404465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:22.407526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:22.409978 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:22.410434 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:22.673980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:22.682658 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-246a988b-b307-4603-9b09-66dd444c0728 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.293954 May 09 18:30:22.683589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 54/107] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:22 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:23.102283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:23.103005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:23.103976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:23.104990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:23.113387 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.115672 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:23.116164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.117786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.118245 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:23.118352 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:23.120368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.121588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:23.427669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:23.432626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:23.439541 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6911839a-51d3-4e9c-8478-4df41fa66d8c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1556 microversion: 2.1 time: 0.339371 May 09 18:30:23.440366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 55/108] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:23 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1556 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:23.453132 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-38df63b3-b8c8-4e01-82ce-ad149ddea696 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1322 microversion: 2.1 time: 0.355070 May 09 18:30:23.456722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 54/109] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:23 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:23.458875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-94b9e5cd-f8f9-47f1-b460-e05161b6f43d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:23.459601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-94b9e5cd-f8f9-47f1-b460-e05161b6f43d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:23.465662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94b9e5cd-f8f9-47f1-b460-e05161b6f43d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.466146 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94b9e5cd-f8f9-47f1-b460-e05161b6f43d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:23.466940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94b9e5cd-f8f9-47f1-b460-e05161b6f43d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.467438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94b9e5cd-f8f9-47f1-b460-e05161b6f43d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:23.587359 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-94b9e5cd-f8f9-47f1-b460-e05161b6f43d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131722 May 09 18:30:23.587707 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 56/110] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:30:23 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:30:23.699840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:23.700476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:23.707495 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.708076 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:23.709219 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:23.709882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:24.010537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:24.022444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bc68f80d-05b2-4239-ae4e-de71098fb979 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.326713 May 09 18:30:24.024071 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 55/111] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:23 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:24.474184 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:24.474816 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:24.482822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:24.483579 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:24.484514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:24.485169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:24.698794 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-5a30508b-bbb8-4b5d-9c04-2be0ab5d6d94 req-14dc4ad2-e96c-4ba7-8d21-3cc1516455bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a805d4-1420-4adb-a173-724abc1e9915", "name": "network-vif-plugged", "status": "completed", "tag": "1e18cb42-6fa5-49f6-8510-1b14aaa7fef4"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:24.717952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5a30508b-bbb8-4b5d-9c04-2be0ab5d6d94 req-14dc4ad2-e96c-4ba7-8d21-3cc1516455bf service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:24.720050 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5a30508b-bbb8-4b5d-9c04-2be0ab5d6d94 req-14dc4ad2-e96c-4ba7-8d21-3cc1516455bf service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:24.752522 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-5a30508b-bbb8-4b5d-9c04-2be0ab5d6d94 req-14dc4ad2-e96c-4ba7-8d21-3cc1516455bf service nova] Creating event network-vif-plugged:1e18cb42-6fa5-49f6-8510-1b14aaa7fef4 for instance a7a805d4-1420-4adb-a173-724abc1e9915 on hv-cinder-84112 May 09 18:30:24.766461 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-5a30508b-bbb8-4b5d-9c04-2be0ab5d6d94 req-14dc4ad2-e96c-4ba7-8d21-3cc1516455bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077012 May 09 18:30:24.768186 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 56/112] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:24.804811 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:24.816757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aacac570-acb3-46a9-a1ef-7d42345edd83 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1516 microversion: 2.1 time: 0.344726 May 09 18:30:24.824038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 57/113] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:24 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:24.842849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:24.844840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:24.859677 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:24.860795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:24.861970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:24.862665 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:24.892950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lazy-loading 'flavor' on Instance uuid f754ac61-c5df-4016-abe2-d0c01e946f0d {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:30:25.042864 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:25.044376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:25.054624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:25.055100 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:25.066487 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:25.067372 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:25.128927 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1ea6cdd1-f721-43b8-9bd2-ffb28b65e7e4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d/action" status: 200 len: 32 microversion: 2.1 time: 0.290610 May 09 18:30:25.133483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 57/114] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:30:24 2022] POST /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:30:25.151423 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:25.152116 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:25.170365 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:25.170887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:25.172196 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:25.172967 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:25.584769 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:25.597060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-54280512-b26e-476f-b46e-aa72f0f0131c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.559696 May 09 18:30:25.598100 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 58/115] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:25 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:25.704764 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:25.714381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2bc1a893-7dc0-4255-aa3b-17a13474a1d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.573308 May 09 18:30:25.715375 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 58/116] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:25 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:26.038298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-0d1bb974-681a-441d-9af4-16ba1a12a7a3 req-c60298b9-9008-482e-9a77-4ebbb181abd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f", "tag": "97fbd8b0-83c4-4955-a743-dfced983ab62"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:26.051140 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0d1bb974-681a-441d-9af4-16ba1a12a7a3 req-c60298b9-9008-482e-9a77-4ebbb181abd7 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:26.051629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0d1bb974-681a-441d-9af4-16ba1a12a7a3 req-c60298b9-9008-482e-9a77-4ebbb181abd7 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:26.072182 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-0d1bb974-681a-441d-9af4-16ba1a12a7a3 req-c60298b9-9008-482e-9a77-4ebbb181abd7 service nova] Creating event network-changed:97fbd8b0-83c4-4955-a743-dfced983ab62 for instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f on hv-cinder-84112 May 09 18:30:26.079465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-0d1bb974-681a-441d-9af4-16ba1a12a7a3 req-c60298b9-9008-482e-9a77-4ebbb181abd7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045046 May 09 18:30:26.080646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 59/117] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:26.615050 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:26.618656 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:26.638379 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:26.639391 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:26.641198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:26.642027 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:26.734875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:26.735813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:26.751318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:26.754743 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:26.756225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:26.758414 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:27.393800 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:27.404657 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d6abd28f-7111-47ee-8971-cd847dbff7e3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1364 microversion: 2.1 time: 0.794303 May 09 18:30:27.406170 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 59/118] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:26 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1364 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:27.574653 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:27.583761 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d80f3527-4e6f-437d-aaa3-739f864de1a2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.853701 May 09 18:30:27.596164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 60/119] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:26 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:30:28.422385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:28.423774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:28.433842 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:28.437053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:28.438909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:28.440933 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:28.603016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:28.604485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:28.623381 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:28.627235 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:28.639873 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:28.641132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:28.831452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:28.843963 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e8b217fe-25f5-49bd-ae11-488930b2e69a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1550 microversion: 2.1 time: 0.424253 May 09 18:30:28.845895 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 60/120] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:28 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1550 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:28.867343 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-64c6a968-f3cb-46f0-b740-ee86cae2091d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:28.868713 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-64c6a968-f3cb-46f0-b740-ee86cae2091d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:28.879832 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64c6a968-f3cb-46f0-b740-ee86cae2091d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:28.880512 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64c6a968-f3cb-46f0-b740-ee86cae2091d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:28.881450 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64c6a968-f3cb-46f0-b740-ee86cae2091d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:28.882022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64c6a968-f3cb-46f0-b740-ee86cae2091d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:28.989383 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:29.005326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6742d055-6c51-4304-9469-0ae8e390a87a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.403797 May 09 18:30:29.010225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 61/121] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:28 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:29.070256 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-64c6a968-f3cb-46f0-b740-ee86cae2091d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204295 May 09 18:30:29.070256 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 61/122] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:30:28 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:30:30.038752 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:30.040156 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:30.063868 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:30.065538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:30.067575 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:30.069138 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:30.276502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:30.297298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e6578e06-b633-4556-9b8a-975a4f0f8ff5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.274855 May 09 18:30:30.299282 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 62/123] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:30 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:31.000005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-6b20768f-7402-46f4-a5ac-20e90cf74a57 req-5264c76a-2559-45ae-8988-93ec8645e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a805d4-1420-4adb-a173-724abc1e9915", "tag": "1e18cb42-6fa5-49f6-8510-1b14aaa7fef4"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:31.018188 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6b20768f-7402-46f4-a5ac-20e90cf74a57 req-5264c76a-2559-45ae-8988-93ec8645e6b8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:31.019012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6b20768f-7402-46f4-a5ac-20e90cf74a57 req-5264c76a-2559-45ae-8988-93ec8645e6b8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:31.040768 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-6b20768f-7402-46f4-a5ac-20e90cf74a57 req-5264c76a-2559-45ae-8988-93ec8645e6b8 service nova] Creating event network-changed:1e18cb42-6fa5-49f6-8510-1b14aaa7fef4 for instance a7a805d4-1420-4adb-a173-724abc1e9915 on hv-cinder-84112 May 09 18:30:31.048838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-6b20768f-7402-46f4-a5ac-20e90cf74a57 req-5264c76a-2559-45ae-8988-93ec8645e6b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055254 May 09 18:30:31.050016 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 62/124] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:31.314253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:31.314981 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:31.326288 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:31.329012 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:31.329923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:31.332060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:31.596385 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:31.607499 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-193c271f-94a4-49e4-a06a-8d74affe409f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.297541 May 09 18:30:31.610165 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 63/125] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:31 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:32.636789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:32.638431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:32.656008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:32.659997 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:32.666994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:32.670081 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:33.062415 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:33.088681 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bc49b99f-ee4b-4f29-b1b8-c9a1d255deee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.452223 May 09 18:30:33.089914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 63/126] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:32 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:33.395288 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:33.396704 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:33.406747 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:33.407209 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:33.408875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:33.409923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:33.451903 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:30:33.654791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9de7c458-482d-4c76-8cdf-57e1576f7498 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 204 len: 0 microversion: 2.1 time: 0.242073 May 09 18:30:33.656027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 64/127] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:30:33 2022] DELETE /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:30:33.664657 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:33.665603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:33.675055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:33.675638 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:33.676585 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:33.677229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:33.924349 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:33.936225 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1f70c060-7077-4a0f-bd85-3245398a5fa5 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1552 microversion: 2.1 time: 0.274895 May 09 18:30:33.938976 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 64/128] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:33 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1552 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:34.119228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:34.123143 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:34.145075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:34.145547 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:34.146360 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:34.148038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:34.354636 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:34.366180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-13a4ebdb-72d1-45b0-a71e-3590d1c91400 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.261403 May 09 18:30:34.367025 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 65/129] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:34 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:34.954519 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:34.955749 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:34.967022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:34.967896 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:34.968744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:34.969201 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:35.174275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:35.187437 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3d3fe11f-d19a-4df7-8732-39a1dfd66756 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1552 microversion: 2.1 time: 0.237011 May 09 18:30:35.203144 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 65/130] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:34 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1552 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:35.386479 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:35.387108 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:35.394733 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:35.397027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:35.398037 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:35.400176 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:35.732382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:35.740704 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5b5680bd-d76a-4396-befc-59de5040bbb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.360557 May 09 18:30:35.755359 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 66/131] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:35 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:36.234851 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:36.240518 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:36.258487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:36.259165 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:36.260167 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:36.260750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:36.774218 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:36.775115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:36.783752 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:36.783752 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:36.784561 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:36.785195 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:37.029084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:37.043915 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-34051182-d9fc-4dab-a3ff-b9bfe91be53b tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1552 microversion: 2.1 time: 0.840796 May 09 18:30:37.045291 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 66/132] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:36 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1552 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:37.442607 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:37.450419 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e3e1f74b-05f6-48b0-aedb-1d9b99982361 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.691995 May 09 18:30:37.463683 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 67/133] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:36 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:37.952270 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-b14ae454-98e5-4034-8e26-01965edeae1a req-4f69b4c0-87a4-4107-90bc-46d8d2ec495e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1074019a-07cc-4aea-8385-4803e00e1d7b", "name": "network-vif-deleted", "tag": "5e0cd009-d38e-452c-a4c4-7736e46f139b"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:37.975682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b14ae454-98e5-4034-8e26-01965edeae1a req-4f69b4c0-87a4-4107-90bc-46d8d2ec495e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:37.984160 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b14ae454-98e5-4034-8e26-01965edeae1a req-4f69b4c0-87a4-4107-90bc-46d8d2ec495e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:38.003737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-b14ae454-98e5-4034-8e26-01965edeae1a req-4f69b4c0-87a4-4107-90bc-46d8d2ec495e service nova] Creating event network-vif-deleted:5e0cd009-d38e-452c-a4c4-7736e46f139b for instance 1074019a-07cc-4aea-8385-4803e00e1d7b on hv-cinder-84112 May 09 18:30:38.015998 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-b14ae454-98e5-4034-8e26-01965edeae1a req-4f69b4c0-87a4-4107-90bc-46d8d2ec495e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068125 May 09 18:30:38.025025 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 67/134] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:38.066684 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:38.069131 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:38.084725 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:38.088306 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:38.093641 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:38.095163 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:38.335875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:38.343971 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ac978e6d-4e5c-4d7e-9a35-b39d6a3015a9 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1345 microversion: 2.1 time: 0.285066 May 09 18:30:38.355611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 68/135] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:38 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1345 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:38.479654 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:38.480781 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:38.488985 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:38.489755 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:38.490910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:38.492030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:38.760353 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:38.774105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-093f90ea-70d8-4cc3-a5aa-f3371549627e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.308815 May 09 18:30:38.775030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 68/136] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:38 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:39.370009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:39.370642 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:39.386774 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:39.391739 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:39.394844 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:39.398923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:39.449311 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:39.449813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:39.450426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lazy-loading 'fault' on Instance uuid 1074019a-07cc-4aea-8385-4803e00e1d7b {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:30:39.532393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3312802ff729418f90e6f25e6faf0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0d940b1aea46aea0fa187448375f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:39.560695 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-789967f9-fc02-42a5-bcc0-7c8163cbb0f2 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 200 len: 1350 microversion: 2.1 time: 0.188397 May 09 18:30:39.561520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 69/137] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:39 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 1350 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:39.794339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:39.795100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:39.801485 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:39.801964 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:39.802737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:39.803378 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:39.951276 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:39.959830 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d3106078-f2f4-4cd2-931e-5b05cf8a2969 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.172101 May 09 18:30:39.960424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 69/138] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:39 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:40.583862 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:40.585138 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:40.599918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:40.600645 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:40.601613 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:40.602455 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:40.621202 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] HTTP exception thrown: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Request method failure captured: May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b HTTP/1.1 May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2PIQus61U5I9TYspr1g4Pk-9DXIsQH8l5eQW0JrwfZWfJ69iJ3zQ5EUyCkBmFfODjyRyCTUrpWyAoROLoDmQPIhcPRpLagI43QSC2Kh-F5Tg48SvqPG25pkLB9STdIRokGMfPn6FADhD0T80KL63WacGTqw1YE_cAnGpPZOQv8cMk May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:30:40.628821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e0d940b1aea46aea0fa187448375f04"}]}] May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-DeleteServersTestJSON-616767868 May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 3312802ff729418f90e6f25e6faf0ee0 May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.630118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '1074019a-07cc-4aea-8385-4803e00e1d7b'} May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:30:40.630969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.632889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:40.638241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Returning 404 to user: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:30:40.639145 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-66d9f1f7-474c-4c44-bb6d-748919f26798 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 404 len: 111 microversion: 2.1 time: 0.062411 May 09 18:30:40.639788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:40 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:30:40.861299 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:40.862386 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:40.869905 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:40.870702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:40.872396 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:40.873047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:40.888780 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] HTTP exception thrown: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Request method failure captured: May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b/os-volume_attachments HTTP/1.1 May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2PIQus61U5I9TYspr1g4Pk-9DXIsQH8l5eQW0JrwfZWfJ69iJ3zQ5EUyCkBmFfODjyRyCTUrpWyAoROLoDmQPIhcPRpLagI43QSC2Kh-F5Tg48SvqPG25pkLB9STdIRokGMfPn6FADhD0T80KL63WacGTqw1YE_cAnGpPZOQv8cMk May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:30:40.893511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e0d940b1aea46aea0fa187448375f04"}]}] May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-DeleteServersTestJSON-616767868 May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 3312802ff729418f90e6f25e6faf0ee0 May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.894703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'server_id': '1074019a-07cc-4aea-8385-4803e00e1d7b'} May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:30:40.895789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:40.896817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:40.899101 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Returning 404 to user: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:30:40.900028 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-91f00be6-7bc0-448f-b864-e3cb32c5e83c tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044955 May 09 18:30:40.900607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 70/140] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:30:40 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:30:40.994734 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:40.996163 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:41.016663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:41.017492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:41.023746 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:41.025142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:41.242833 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:41.252319 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-067b6476-480e-4b5f-a957-bafd199cff45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.278143 May 09 18:30:41.252959 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 71/141] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:40 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:42.195976 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:42.196474 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:42.203509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:42.204190 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:42.205265 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:42.205806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:42.219755 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] HTTP exception thrown: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Request method failure captured: May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b HTTP/1.1 May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2PIQus61U5I9TYspr1g4Pk-9DXIsQH8l5eQW0JrwfZWfJ69iJ3zQ5EUyCkBmFfODjyRyCTUrpWyAoROLoDmQPIhcPRpLagI43QSC2Kh-F5Tg48SvqPG25pkLB9STdIRokGMfPn6FADhD0T80KL63WacGTqw1YE_cAnGpPZOQv8cMk May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:30:42.222465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e0d940b1aea46aea0fa187448375f04"}]}] May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-DeleteServersTestJSON-616767868 May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 3312802ff729418f90e6f25e6faf0ee0 May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.223803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '1074019a-07cc-4aea-8385-4803e00e1d7b'} May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:30:42.224554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.225855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:30:42.228186 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Returning 404 to user: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:30:42.228186 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-48aa2783-6926-4ee2-a09a-1d36d3f885e3 tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 404 len: 111 microversion: 2.1 time: 0.032004 May 09 18:30:42.228186 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 71/142] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:30:42 2022] DELETE /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:30:42.241079 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:42.241824 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] [instance: 1074019a-07cc-4aea-8385-4803e00e1d7b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:42.252082 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:42.252712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:42.253287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:42.253742 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:42.269922 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:42.271007 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:42.271625 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] HTTP exception thrown: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Request method failure captured: May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b HTTP/1.1 May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2PIQus61U5I9TYspr1g4Pk-9DXIsQH8l5eQW0JrwfZWfJ69iJ3zQ5EUyCkBmFfODjyRyCTUrpWyAoROLoDmQPIhcPRpLagI43QSC2Kh-F5Tg48SvqPG25pkLB9STdIRokGMfPn6FADhD0T80KL63WacGTqw1YE_cAnGpPZOQv8cMk May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:30:42.274376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e0d940b1aea46aea0fa187448375f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e0d940b1aea46aea0fa187448375f04"}]}] May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-DeleteServersTestJSON-616767868 May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 3e0d940b1aea46aea0fa187448375f04 May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-DeleteServersTestJSON-616767868 May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 3312802ff729418f90e6f25e6faf0ee0 May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-DeleteServersTestJSON-616767868-project May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.275736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '1074019a-07cc-4aea-8385-4803e00e1d7b'} May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:30:42.276603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. May 09 18:30:42.277912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:30:42.281256 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:42.281756 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:42.282578 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:42.285488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] Returning 404 to user: Instance 1074019a-07cc-4aea-8385-4803e00e1d7b could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:30:42.286709 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:42.287211 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-22e14a79-e068-4feb-b08b-2b79035b935d tempest-DeleteServersTestJSON-616767868 tempest-DeleteServersTestJSON-616767868-project] 10.222.0.25 "GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b" status: 404 len: 111 microversion: 2.1 time: 0.055175 May 09 18:30:42.288528 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 72/143] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:42 2022] GET /compute/v2.1/servers/1074019a-07cc-4aea-8385-4803e00e1d7b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:30:42.596623 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:42.606612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2a66244f-c4c9-4512-835d-5009e6e9bde4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.340259 May 09 18:30:42.619275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 72/144] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:42 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:43.624910 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:43.625826 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:43.638532 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:43.641408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:43.642331 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:43.643420 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:43.886526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:43.899383 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5b6f5e2e-49fb-433e-b3f7-fe3bb715e052 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.274870 May 09 18:30:43.900295 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 73/145] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:43 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:44.916997 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:44.919880 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:44.938928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:44.940424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:44.941327 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:44.943462 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:45.284026 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:45.291724 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b9cf8a63-6368-48f3-b9d6-3d85a189489f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.378730 May 09 18:30:45.309532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 73/146] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:44 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:46.320137 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:46.321545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:46.331586 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:46.333138 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:46.336597 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:46.337498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:47.143367 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:47.153538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-83c022f1-cba0-4f99-b269-06d0bb5f3c7b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.838434 May 09 18:30:47.154134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 74/147] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:46 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:48.172631 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:48.173948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:48.194545 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:48.195793 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:48.196790 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:48.197390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:48.685512 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:48.723334 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f258f507-c060-41f3-a37b-093e9b1372a6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.553678 May 09 18:30:48.727393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 74/148] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:48 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:49.742646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:49.744356 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:49.758160 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:49.759633 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:49.761439 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:49.767785 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:50.198196 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:50.212115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-68a8f4f4-c4b8-4c41-b03d-5da6cd2264c8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.473782 May 09 18:30:50.221212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 75/149] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:49 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:50.595455 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-62c52e3d-a62d-47aa-8560-63d0af2ca0b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Action: 'create', calling method: .version_select at 0x7f3f7f196310>, body: {"keypair": {"name": "tempest-TestShelveInstance-35052776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWRjhr7hR8S18ilzS5dHZAvdogCVpc8m4zmalle8B8tbqFPua/UsOy55NN6JZuaV0k5zL+l7iSGgujZsypwJbE4h84wxMU2kLhQIxn0Gz6FQ3j4vI1XODD2Xm6uKkFf5g=="}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:50.620040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-62c52e3d-a62d-47aa-8560-63d0af2ca0b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Getting quotas for project 9c6e0a23a3414fca84248553e4f85005. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:30:50.625954 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-62c52e3d-a62d-47aa-8560-63d0af2ca0b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Getting quotas for user 96dcd82937834f89889c43a1fefc1bff and project 9c6e0a23a3414fca84248553e4f85005. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:30:50.675056 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-62c52e3d-a62d-47aa-8560-63d0af2ca0b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.350766 May 09 18:30:50.676281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 75/150] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:30:50 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:30:51.239990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:51.242631 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:51.250571 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:51.251203 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:51.252407 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:51.252992 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:51.837118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:51.844678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-84115401-2dd3-4b16-a72a-790c24076480 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.611788 May 09 18:30:51.845268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 76/151] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:51 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:52.865323 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:52.867435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:52.884093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:52.896581 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:52.899210 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:52.900974 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:53.508891 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:53.524280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1f2534f0-f7b2-43fa-b94c-d8ef89a8a0c4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.665816 May 09 18:30:53.525430 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 76/152] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:52 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:54.408056 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f4e62701-3ccc-4ace-b3c7-1332c5156608 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'create', calling method: .version_select at 0x7f3f7e991280>, body: {"keypair": {"name": "tempest-keypair-888096569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYtHOGYifDifKoD/IsSgHe4AFQSOGF7sgQ4P47ISNByy+HlwMI53Gej1EG0aMcIMiKSMe4H1nAv/zKTKzdEUozjPUeSwLkBwr+IA5P+knG3VbWIvSZLJdRSBERE2ITL7w=="}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:54.423708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-f4e62701-3ccc-4ace-b3c7-1332c5156608 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for project 127c608e5ebd478282b045739182c41e. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:30:54.429423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-f4e62701-3ccc-4ace-b3c7-1332c5156608 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for user cac32da403af402c8236f46168e81038 and project 127c608e5ebd478282b045739182c41e. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:30:54.468180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f4e62701-3ccc-4ace-b3c7-1332c5156608 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.139567 May 09 18:30:54.469168 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 77/153] 10.222.0.25 () {62 vars in 1199 bytes} [Mon May 9 18:30:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 09 18:30:54.546463 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:54.547660 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:54.559924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:54.560634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:54.561665 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:54.562182 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:54.932853 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:54.941899 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-484ea074-069f-4853-8f6c-21cc9b0807b3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.401175 May 09 18:30:54.942892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 77/154] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:54 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:55.959465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:55.960792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:55.967715 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:55.968299 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:55.969386 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:55.969904 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:56.214221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:56.226183 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2f0e6434-5258-4171-b2a1-1b175a4678ae tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.269079 May 09 18:30:56.226793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 78/155] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:55 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:56.299545 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-487391259", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5e8d460-3fdc-4b49-8c18-f792777a0c26"}], "security_groups": [{"name": "tempest-securitygroup--922095905"}], "key_name": "tempest-keypair-888096569", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:30:56.401608 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] validate_networks() for [('f5e8d460-3fdc-4b49-8c18-f792777a0c26', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:30:56.770793 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:30:56.771262 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:30:56.771746 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:30:56.772163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:30:56.772584 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:30:56.781173 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:56.781631 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:56.782437 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:56.782879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:56.799815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for project 127c608e5ebd478282b045739182c41e. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:30:56.804008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for user cac32da403af402c8236f46168e81038 and project 127c608e5ebd478282b045739182c41e. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:30:56.815864 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:30:56.818165 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:30:56.867270 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d3eff657-f0d4-4985-9cb4-4baad9becd8d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.572133 May 09 18:30:56.868228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 78/156] 10.222.0.25 () {62 vars in 1187 bytes} [Mon May 9 18:30:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 18:30:56.880579 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cc67a137-b19a-4c74-ac96-9eee6c12fe45 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:56.881210 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cc67a137-b19a-4c74-ac96-9eee6c12fe45 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:56.947478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cc67a137-b19a-4c74-ac96-9eee6c12fe45 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:56.956529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cc67a137-b19a-4c74-ac96-9eee6c12fe45 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:56.959198 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cc67a137-b19a-4c74-ac96-9eee6c12fe45 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:56.960452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cc67a137-b19a-4c74-ac96-9eee6c12fe45 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1280 microversion: 2.20 time: 0.084060 May 09 18:30:56.961343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 79/157] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:30:56 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:30:57.244179 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:57.246179 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:57.255215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:57.255853 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:57.256944 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:57.257538 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:57.398002 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:57.406334 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4a2bde7d-9e65-46a6-9fd9-76aae52dedc5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.166914 May 09 18:30:57.406905 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 79/158] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:57 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:57.979730 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:57.980457 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:57.986683 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:57.987530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:57.988386 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:57.988980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:58.059445 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:58.068197 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:58.069851 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:58.071088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-20e8c9ab-ae06-471e-a4d7-ba52fa715553 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1332 microversion: 2.20 time: 0.095573 May 09 18:30:58.071897 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 80/159] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:30:57 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:30:58.424100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:58.425198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:58.432514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:58.432979 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:58.434346 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:58.434800 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:58.621325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:58.630004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c31820c4-f9fd-4291-8750-ecbc9bdd1ab8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.209529 May 09 18:30:58.640049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 80/160] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:58 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:30:59.095283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:59.096679 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:59.102913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:59.103415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:59.104630 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:59.105160 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:59.317056 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:59.345750 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:59.349913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:59.351741 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ad37353f-4299-44d2-ad69-79afcb315373 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.260779 May 09 18:30:59.352578 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 81/161] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:30:59 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:30:59.656279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:30:59.658589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:30:59.672008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:59.673050 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:59.674297 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:30:59.674927 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:30:59.973239 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:30:59.983310 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-eeb5566c-743b-4575-b2be-5713f05c5dd1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.339798 May 09 18:30:59.984404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 81/162] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:30:59 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:00.260281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-4f567352-1572-44f5-9fa3-465b6b9cca28 req-b462232e-2657-45a6-8e5e-13746460d9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b5c8d4-23e0-426a-806c-d472fcd826fb", "tag": "8c59628d-9fbb-446b-9fc4-96acde9b707f"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:00.281152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-4f567352-1572-44f5-9fa3-465b6b9cca28 req-b462232e-2657-45a6-8e5e-13746460d9e8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:00.283222 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-4f567352-1572-44f5-9fa3-465b6b9cca28 req-b462232e-2657-45a6-8e5e-13746460d9e8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:00.322022 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-4f567352-1572-44f5-9fa3-465b6b9cca28 req-b462232e-2657-45a6-8e5e-13746460d9e8 service nova] Creating event network-changed:8c59628d-9fbb-446b-9fc4-96acde9b707f for instance 02b5c8d4-23e0-426a-806c-d472fcd826fb on hv-cinder-84112 May 09 18:31:00.330736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-4f567352-1572-44f5-9fa3-465b6b9cca28 req-b462232e-2657-45a6-8e5e-13746460d9e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073823 May 09 18:31:00.335908 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 82/163] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:00.372052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:00.379745 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:00.392217 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:00.393056 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:00.395413 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:00.396057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:00.766675 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:00.780721 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:00.782270 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:00.783482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-719ed18f-fea3-4f3c-abe3-d99752c65fea tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.417565 May 09 18:31:00.791220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 82/164] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:00 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:01.004038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:01.005008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:01.025728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:01.026274 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:01.027811 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:01.028471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:01.176153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:01.184574 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-95bb7bda-b640-497d-aa5d-f00e655bec6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.187086 May 09 18:31:01.185151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 83/165] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:00 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:01.802655 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:01.803274 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:01.811758 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:01.812233 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:01.813020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:01.813520 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:02.015161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:02.027444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:02.027444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:02.027444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-80ba9896-2fa8-4262-89a1-1064f6da05a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.229225 May 09 18:31:02.031315 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 83/166] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:01 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:02.206283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:02.206976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:02.216924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:02.217468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:02.218457 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:02.218954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:02.361649 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:02.369009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bc705434-a166-4cf2-a9ce-c10bc23e45f9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.167093 May 09 18:31:02.369572 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 84/167] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:02 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:03.044697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:03.045322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:03.052345 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:03.052812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:03.053602 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:03.054047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:03.270582 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:03.287341 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:03.289111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:03.290380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f90d0f67-fc4d-4eee-b6d4-9a98393ccb5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.249601 May 09 18:31:03.291766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 84/168] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:03 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:03.386733 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:03.387603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:03.398417 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:03.399353 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:03.402611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:03.403141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:03.654263 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:03.665402 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ae8cab9d-47fc-4832-8909-7276e96e0da0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.282844 May 09 18:31:03.665985 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 85/169] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:03 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:04.307353 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:04.308005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:04.314493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:04.315052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:04.315840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:04.316287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:04.448573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:04.457678 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:04.459313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:04.460490 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5bcf15a7-5418-402b-94c2-447ea305e382 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.157140 May 09 18:31:04.461062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 85/170] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:04 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:04.681992 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:04.682616 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:04.688752 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:04.688853 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:04.689685 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:04.690038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:04.823658 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:04.834718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0480902f-8ea8-487a-a088-e9feb2c105e7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.156335 May 09 18:31:04.836036 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 86/171] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:04 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:05.478440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:05.479198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:05.485529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:05.486056 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:05.486825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:05.487303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:05.658551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:05.673478 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:05.675952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:05.677524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2890a8ba-acf4-4bb0-b6cf-f3fe568fc37f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.203181 May 09 18:31:05.678370 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 86/172] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:05 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:05.858498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:05.859268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:05.865342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:05.865917 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:05.866799 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:05.867386 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:06.017283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:06.026557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-22c965ab-a24b-44df-a7bc-1891bffb249c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.175928 May 09 18:31:06.027919 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 87/173] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:05 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:06.696517 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:06.697137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:06.704854 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:06.706411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:06.707443 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:06.708001 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:06.868181 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:06.877579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:06.879088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:06.880228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6a5898bf-2301-41ad-8178-ff6db4ac6390 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.187576 May 09 18:31:06.891206 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 87/174] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:06 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:31:07.046601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:07.047989 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:07.054792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:07.055669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:07.056871 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:07.057478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:07.267996 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:07.275362 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-94cb729d-8133-4f74-8515-341a12b93e62 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.234803 May 09 18:31:07.275937 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 88/175] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:07 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:07.903550 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:07.904180 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:07.910424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:07.910884 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:07.911688 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:07.912137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:08.048476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:08.056182 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:08.057701 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:08.058850 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-27e505fd-b800-42d2-8180-1e79c43d9961 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.159833 May 09 18:31:08.059452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 88/176] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:07 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:08.292352 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:08.292979 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:08.298751 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:08.299237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:08.300016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:08.300465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:08.445068 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:08.454710 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e639b43c-927a-4634-828d-f4355b562430 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.165949 May 09 18:31:08.455315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 89/177] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:08 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:09.077925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:09.078569 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:09.085821 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:09.086292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:09.087092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:09.087605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:09.224314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:09.234702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:09.236391 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:09.237633 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f56361f0-fd7f-429d-95a6-00fde0d5051f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.164935 May 09 18:31:09.238293 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 89/178] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:09 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:09.470895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:09.471468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:09.477448 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:09.477910 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:09.478807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:09.479422 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:09.610037 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:09.618386 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-82da2979-6c85-42c3-be6a-26f1de4d5ba5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.151451 May 09 18:31:09.619060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 90/179] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:09 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:10.005988 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-45e25598-982d-461d-9d00-fe1abf4adcf3 req-c5e0aa40-a454-4107-8c9e-604bb4b66066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5c8d4-23e0-426a-806c-d472fcd826fb", "name": "network-vif-plugged", "status": "completed", "tag": "8c59628d-9fbb-446b-9fc4-96acde9b707f"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:10.015163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-45e25598-982d-461d-9d00-fe1abf4adcf3 req-c5e0aa40-a454-4107-8c9e-604bb4b66066 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:10.015662 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-45e25598-982d-461d-9d00-fe1abf4adcf3 req-c5e0aa40-a454-4107-8c9e-604bb4b66066 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:10.028564 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-45e25598-982d-461d-9d00-fe1abf4adcf3 req-c5e0aa40-a454-4107-8c9e-604bb4b66066 service nova] Creating event network-vif-plugged:8c59628d-9fbb-446b-9fc4-96acde9b707f for instance 02b5c8d4-23e0-426a-806c-d472fcd826fb on hv-cinder-84112 May 09 18:31:10.034332 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-45e25598-982d-461d-9d00-fe1abf4adcf3 req-c5e0aa40-a454-4107-8c9e-604bb4b66066 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031992 May 09 18:31:10.035444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 90/180] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:10.257396 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:10.258977 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:10.266491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:10.267119 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:10.268082 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:10.268724 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:10.428913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:10.438273 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:10.440059 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:10.441294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a48cd20a-171a-4038-873a-8706c8cf632c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.189604 May 09 18:31:10.441861 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 91/181] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:10 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:10.639948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:10.641889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:10.648999 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:10.649646 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:10.650567 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:10.651013 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:10.777638 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:10.784881 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-453d153f-339a-4136-981b-45370df1d528 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.151053 May 09 18:31:10.785445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 91/182] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:10 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:11.459557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:11.460186 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:11.466641 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:11.467112 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:11.467918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:11.468368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:11.597254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:11.605170 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:11.606700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:11.607881 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-caa16324-cf24-4045-83d6-564e9c0f5a19 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1405 microversion: 2.20 time: 0.152293 May 09 18:31:11.608452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 92/183] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:11 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:11.801633 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:11.802183 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:11.808656 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:11.809121 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:11.809945 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:11.810396 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:11.948149 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:11.961241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f33970c5-a06c-40fc-b079-7f1a2842fb06 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.163405 May 09 18:31:11.974095 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 92/184] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:11 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:12.628450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:12.629145 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:12.644612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:12.645078 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:12.649545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:12.650307 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:12.815306 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:12.824838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:12.826340 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:12.827711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1522fcf3-6be1-42a9-ba95-8f40a92e12b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1597 microversion: 2.20 time: 0.205904 May 09 18:31:12.828799 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 93/185] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:31:12 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1597 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:31:12.846347 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d90de2ca-e44e-4d47-a0b7-4209bcb21afb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:12.846914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d90de2ca-e44e-4d47-a0b7-4209bcb21afb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:12.853623 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d90de2ca-e44e-4d47-a0b7-4209bcb21afb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:12.854077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d90de2ca-e44e-4d47-a0b7-4209bcb21afb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:12.855454 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d90de2ca-e44e-4d47-a0b7-4209bcb21afb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:12.855960 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d90de2ca-e44e-4d47-a0b7-4209bcb21afb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:12.935671 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d90de2ca-e44e-4d47-a0b7-4209bcb21afb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093660 May 09 18:31:12.936729 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 93/186] 10.222.0.25 () {60 vars in 1315 bytes} [Mon May 9 18:31:12 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:31:12.978416 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:12.979086 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:12.986127 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:12.986944 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:12.988083 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:12.988678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:13.273269 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:13.281254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-43899365-4a6b-4401-9f8c-6a4bc0ef7060 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.306759 May 09 18:31:13.282034 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 94/187] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:12 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:14.301290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:14.301931 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:14.309398 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:14.309864 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:14.310675 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:14.311125 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:14.515095 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:14.525181 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a2b7182b-180c-4635-adcd-edd077aaf7cd tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.230757 May 09 18:31:14.531850 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-707f3906-f7c7-454a-9f83-c8d5d77f90f8 req-eea850bd-5bf8-429d-990a-65b9128eae4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b5c8d4-23e0-426a-806c-d472fcd826fb", "tag": "8c59628d-9fbb-446b-9fc4-96acde9b707f"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:14.539484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 94/188] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:14 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:14.539802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-707f3906-f7c7-454a-9f83-c8d5d77f90f8 req-eea850bd-5bf8-429d-990a-65b9128eae4b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:14.540283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-707f3906-f7c7-454a-9f83-c8d5d77f90f8 req-eea850bd-5bf8-429d-990a-65b9128eae4b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:14.552089 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-707f3906-f7c7-454a-9f83-c8d5d77f90f8 req-eea850bd-5bf8-429d-990a-65b9128eae4b service nova] Creating event network-changed:8c59628d-9fbb-446b-9fc4-96acde9b707f for instance 02b5c8d4-23e0-426a-806c-d472fcd826fb on hv-cinder-84112 May 09 18:31:14.557072 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-707f3906-f7c7-454a-9f83-c8d5d77f90f8 req-eea850bd-5bf8-429d-990a-65b9128eae4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028722 May 09 18:31:14.557704 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 95/189] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:31:15.542862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:15.543546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:15.550055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:15.550523 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:15.551359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:15.551812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:15.692342 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:15.699952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e2c26e13-d05f-4689-8f61-3379b3b2bf09 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.161844 May 09 18:31:15.700617 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 95/190] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:15 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:16.717408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:16.718119 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:16.724221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:16.724682 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:16.725457 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:16.725903 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:16.853104 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:16.861518 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d59ef8f7-8d15-4a8c-8792-338a7d7b546a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.148280 May 09 18:31:16.862030 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 96/191] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:16 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:17.879809 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:17.883648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:17.889789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:17.890250 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:17.891045 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:17.891589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:18.025001 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:18.032313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-72ef7c89-65af-43f9-98d3-c35549a88e8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.156543 May 09 18:31:18.032887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 96/192] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:17 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:19.049207 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:19.049827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:19.055540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:19.056003 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:19.056768 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:19.057211 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:19.193877 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:19.201713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8448b45d-1120-4f91-8cb7-7029724b1209 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.156344 May 09 18:31:19.202288 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 97/193] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:19 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:20.217738 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:20.218980 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:20.225275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:20.225734 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:20.226526 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:20.227282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:20.361381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:20.367323 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-92818484-1942-4096-8e01-1ad27ce1b566 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.153450 May 09 18:31:20.367979 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 97/194] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:20 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:21.385225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:21.386741 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:21.392890 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:21.393347 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:21.394179 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:21.394663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:21.536793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:21.544642 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6d4b74c1-307d-4de5-b277-dfdedf1118ee tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.163242 May 09 18:31:21.545227 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 98/195] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:21 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:22.562265 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:22.563585 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:22.570562 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:22.571022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:22.571842 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:22.572286 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:22.715031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:22.722426 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-55f47279-9e68-46c1-b16c-aa5b185cd463 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.164327 May 09 18:31:22.722991 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 98/196] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:22 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:23.739835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:23.741093 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:23.749083 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:23.749932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:23.751024 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:23.751791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:23.889920 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:23.897230 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a45bfd4a-eea7-4142-8d5f-153d75342fb4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.161284 May 09 18:31:23.897803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 99/197] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:23 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:24.913810 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:24.914349 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:24.920678 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:24.921142 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:24.921913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:24.922356 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:25.061173 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:25.068950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a61804f9-8e82-4b77-8a02-aa5f3564cd6f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1522 microversion: 2.1 time: 0.159065 May 09 18:31:25.069524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 99/198] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:24 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:26.087986 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:26.090034 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:26.095131 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:26.095620 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:26.096400 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:26.096839 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:26.225115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:26.232449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2969d907-ad94-486a-908e-94ada794554c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1502 microversion: 2.1 time: 0.148462 May 09 18:31:26.233020 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 100/199] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:26 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:26.248722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:26.249543 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:26.262856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:26.263352 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:26.264151 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:26.264601 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:26.392444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:26.399806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-05915457-6351-4597-a144-76eb2e12a5f8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1516 microversion: 2.1 time: 0.155475 May 09 18:31:26.400380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 100/200] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:26 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:27.762425 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:27.763544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:27.769895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:27.770360 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:27.771135 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:27.771611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:27.793829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lazy-loading 'flavor' on Instance uuid 5e67e009-eec8-48f1-b8ec-5ba755aeba51 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:31:27.912781 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5861ab1e-3d4d-4dc2-a067-821934b2a621 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51/action" status: 200 len: 32 microversion: 2.1 time: 0.155939 May 09 18:31:27.913383 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 101/201] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:31:27 2022] POST /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:31:27.923323 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:27.923955 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:27.930454 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:27.930914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:27.931768 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:27.932934 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:28.160675 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:28.169569 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fbf19040-7bd2-4ab3-b740-be579eb817d6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.250965 May 09 18:31:28.170595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 101/202] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:27 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:29.187754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:29.188453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:29.194359 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:29.194822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:29.195619 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:29.196060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:29.350060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:29.358123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e29e10e5-10c9-44c1-a7b6-cc1bd4f48331 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.174270 May 09 18:31:29.358827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 102/203] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:29 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:30.377292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:30.377292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:30.383499 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:30.383961 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:30.384747 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:30.385684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:30.520809 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:30.528784 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-076b5af1-d607-49c2-8b45-704ba152c152 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.156926 May 09 18:31:30.534571 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 102/204] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:30 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:31.546256 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:31.546882 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:31.552723 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:31.553182 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:31.553993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:31.554429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:31.688265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:31.696435 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-626629ce-73a9-4716-bfbf-84f80b9c8bf3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.154553 May 09 18:31:31.697019 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 103/205] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:31 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:32.714464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:32.715110 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:32.721359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:32.721820 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:32.722593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:32.723037 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:32.850902 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:32.858733 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a7a8f573-7406-4227-b532-3fa01cdef809 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.148139 May 09 18:31:32.859331 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 103/206] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:32 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:33.036606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6e3c6256-8750-411f-837f-44f6c4a2bfd2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:33.037137 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6e3c6256-8750-411f-837f-44f6c4a2bfd2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:33.043654 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e3c6256-8750-411f-837f-44f6c4a2bfd2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:33.044113 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e3c6256-8750-411f-837f-44f6c4a2bfd2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:33.044885 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e3c6256-8750-411f-837f-44f6c4a2bfd2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:33.045332 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e3c6256-8750-411f-837f-44f6c4a2bfd2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:33.067658 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6e3c6256-8750-411f-837f-44f6c4a2bfd2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/ips" status: 200 len: 149 microversion: 2.1 time: 0.034787 May 09 18:31:33.068244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 104/207] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:31:33 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:33.875792 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:33.876676 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:33.882912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:33.883406 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:33.884167 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:33.884621 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:34.033814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:34.041134 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-94de0891-e82b-46a8-b827-929368660eac tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.169222 May 09 18:31:34.042256 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 104/208] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:33 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:35.058360 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:35.058983 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:35.065995 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:35.066449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:35.067233 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:35.067674 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:35.196727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:35.204168 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1b8f37e4-e1bf-401f-ad70-114a4d664b3b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.150274 May 09 18:31:35.204769 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 105/209] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:35 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:36.222202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:36.224049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:36.230640 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:36.231105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:36.232084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:36.233000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:36.434113 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:36.441449 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3b4a702d-bf4f-4a5e-8236-5de34b26580f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.223945 May 09 18:31:36.443247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 105/210] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:36 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:36.507022 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d8ddfe15-e0a7-4ba5-a11d-956c1527e9f0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c48dfa73-bec5-44de-88f1-893161bf2d1e"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:36.508179 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d8ddfe15-e0a7-4ba5-a11d-956c1527e9f0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:36.514023 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8ddfe15-e0a7-4ba5-a11d-956c1527e9f0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:36.514486 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8ddfe15-e0a7-4ba5-a11d-956c1527e9f0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:36.515338 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8ddfe15-e0a7-4ba5-a11d-956c1527e9f0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:36.515910 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8ddfe15-e0a7-4ba5-a11d-956c1527e9f0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:36.798168 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d8ddfe15-e0a7-4ba5-a11d-956c1527e9f0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295424 May 09 18:31:36.798897 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 106/211] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:31:36 2022] POST /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:31:37.457655 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:37.458286 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:37.464613 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:37.465077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:37.465854 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:37.466304 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:37.593505 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:37.601140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-66cf4ad0-ad93-4819-964d-0967c5fec018 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.147322 May 09 18:31:37.601812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:37 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:38.619223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:38.619981 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:38.625980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:38.626698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:38.627483 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:38.627926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:38.773098 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:38.781699 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d450ab79-3f6b-47e0-8cdb-19e6704feb80 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.167210 May 09 18:31:38.782272 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 107/213] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:38 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:39.398559 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4d96a2bb-316f-4f41-8b95-839b7e630612 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:39.399077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4d96a2bb-316f-4f41-8b95-839b7e630612 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:39.407478 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d96a2bb-316f-4f41-8b95-839b7e630612 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:39.407932 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d96a2bb-316f-4f41-8b95-839b7e630612 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:39.408775 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d96a2bb-316f-4f41-8b95-839b7e630612 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:39.409206 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d96a2bb-316f-4f41-8b95-839b7e630612 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:39.434017 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4d96a2bb-316f-4f41-8b95-839b7e630612 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/ips" status: 200 len: 145 microversion: 2.1 time: 0.040015 May 09 18:31:39.434609 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 107/214] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:31:39 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:39.798555 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:39.799196 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:39.805478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:39.805943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:39.806712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:39.807229 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:40.083940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:40.091420 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ee8a2ec4-5228-4a71-aebc-52db9b85a0d7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.296745 May 09 18:31:40.092008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 108/215] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:39 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:41.108339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:41.108965 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:41.115564 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:41.116029 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:41.116810 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:41.117261 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:41.241137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:41.250110 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a91c99dc-13f5-48f2-a9e3-04931ffe9904 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.145539 May 09 18:31:41.250856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 108/216] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:41 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:41.559684 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1158924793", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-35052776", "security_groups": [{"name": "tempest-secgroup-smoke-1221972783"}], "networks": [{"uuid": "df47341c-d908-44c0-be75-4cae06738de8"}], "block_device_mapping_v2": [{"uuid": "d968fe71-f77b-4e99-8ce0-2e014fb20d68", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:41.673364 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] validate_networks() for [('df47341c-d908-44c0-be75-4cae06738de8', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:31:42.087002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:31:42.087496 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:31:42.088876 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:31:42.089398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:31:42.089821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:31:42.100415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.100874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:42.101677 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.102121 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:42.122621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Getting quotas for project 9c6e0a23a3414fca84248553e4f85005. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:42.127322 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Getting quotas for user 96dcd82937834f89889c43a1fefc1bff and project 9c6e0a23a3414fca84248553e4f85005. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:42.184001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:31:42.186146 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d968fe71-f77b-4e99-8ce0-2e014fb20d68',volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:31:42.268461 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:42.269072 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:42.276923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.277509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:42.278385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:42.278840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:42.310248 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-29225184-02d2-41e6-a087-f45d22805969 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754867 May 09 18:31:42.311231 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 109/217] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:31:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:31:42.323002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d73160a1-2c2d-4e5e-b01d-8d8b259f9227 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:42.323941 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d73160a1-2c2d-4e5e-b01d-8d8b259f9227 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:42.404918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d73160a1-2c2d-4e5e-b01d-8d8b259f9227 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:42.411728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d73160a1-2c2d-4e5e-b01d-8d8b259f9227 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1087 microversion: 2.1 time: 0.093139 May 09 18:31:42.412431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 110/218] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:42 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1087 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:42.442243 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:42.450453 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e99975e4-6922-4c5c-89bc-1dc20118bd4f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.185734 May 09 18:31:42.451029 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 109/219] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:42 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:43.096290 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-50f126f8-dcf0-4786-a60d-2941f3cef332 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2345eb9f-0f1e-4639-8435-d0259209b849"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:43.097426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-50f126f8-dcf0-4786-a60d-2941f3cef332 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:43.105153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50f126f8-dcf0-4786-a60d-2941f3cef332 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.105729 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50f126f8-dcf0-4786-a60d-2941f3cef332 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.107199 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50f126f8-dcf0-4786-a60d-2941f3cef332 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.107656 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50f126f8-dcf0-4786-a60d-2941f3cef332 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.429042 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:43.429589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:43.436908 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.437505 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.438472 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.439023 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.508751 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:43.516449 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5099e6e8-becd-412a-bd84-c28269246a94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1185 microversion: 2.1 time: 0.091406 May 09 18:31:43.517023 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 110/220] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:43 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:43.521803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:43.522418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:43.529043 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.529547 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.530378 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:43.530858 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:43.663823 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:43.671872 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-369a49db-2d82-4868-a86d-9fbfb6d83a4e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.153553 May 09 18:31:43.672619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 111/221] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:43 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:44.124737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-50f126f8-dcf0-4786-a60d-2941f3cef332 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.031621 May 09 18:31:44.126341 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 111/222] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:31:43 2022] POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:44.533818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:44.535279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:44.542824 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.543311 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:44.544285 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.544891 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:44.627514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:44.637606 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7e338859-fc0d-42ff-be8a-5bc88322c3a2 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1203 microversion: 2.1 time: 0.107304 May 09 18:31:44.648122 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 112/223] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:44 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1203 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:44.689976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:44.690738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:44.699421 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.699895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:44.701011 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:44.701590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:44.891468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:44.899119 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ec8d9b6f-4bc8-4b6c-8ab2-0326c68f7c4b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.214321 May 09 18:31:44.899726 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 112/224] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:44 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:45.363841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c07071b6-4159-41bb-a6c2-a96f62979188 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: .version_select at 0x7f3f80fe50d0>, body: {"keypair": {"name": "tempest-keypair-1682559405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApnnWXPNwnSY8hAOO08GcynjA/s04kubqgncA79qnQhVdpR7uWnuHFaalwmE65UdTjKZkdm95ev09QZdRJMzUXTtxSjk5gBn1NQxoHwkypAreUuSDl/2BrNfxXLReKlhw=="}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:45.387559 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-c07071b6-4159-41bb-a6c2-a96f62979188 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:45.391850 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-c07071b6-4159-41bb-a6c2-a96f62979188 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:45.419448 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c07071b6-4159-41bb-a6c2-a96f62979188 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062268 May 09 18:31:45.420141 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 113/225] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:31:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:45.657647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:45.658342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:45.670255 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.670947 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:45.672261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.672965 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:45.830656 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:45.838601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3aefff73-654e-4e7e-ad33-6a3e27d97fd6 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1271 microversion: 2.1 time: 0.187609 May 09 18:31:45.839408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 113/226] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:45 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:45.917595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:45.918244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:45.925053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.925510 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:45.926300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:45.926745 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:46.071081 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:46.079649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f61be0b1-1bd4-4578-a9ad-656328d3572e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.166471 May 09 18:31:46.080318 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 114/227] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:45 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:46.706677 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1667689644", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "301e94ce-a989-4fe3-9992-0fa06fbc5e5e"}], "security_groups": [{"name": "tempest-securitygroup--1050835307"}], "key_name": "tempest-keypair-1682559405", "user_data": "}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:46.805409 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] validate_networks() for [('301e94ce-a989-4fe3-9992-0fa06fbc5e5e', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:31:46.857352 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:46.857974 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:46.863752 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:46.864211 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:46.864977 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:46.865419 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.051624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:47.060136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-15e2b178-a581-403f-8afd-57a9c105cd85 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1271 microversion: 2.1 time: 0.207635 May 09 18:31:47.060715 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 115/228] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:46 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:47.098795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:47.099584 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:47.106074 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.106543 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.107388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.107836 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.269831 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:31:47.270347 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:31:47.270901 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:31:47.271465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:31:47.271921 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:31:47.282413 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.282795 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.283639 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:47.284088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:47.291928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:47.299568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-05c10d35-e352-41a8-a8ec-41c2c98ca6e9 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.206119 May 09 18:31:47.300244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 116/229] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:47 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:47.302336 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:31:47.306405 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:31:47.317416 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:31:47.319696 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:31:47.366313 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f6a6fb65-5a2e-4955-b4ad-d3021fecfddd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663882 May 09 18:31:47.367029 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 114/230] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:31:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:31:47.377245 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f283613a-376b-4a02-b0a5-b7258c815a84 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:47.377875 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f283613a-376b-4a02-b0a5-b7258c815a84 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:47.429520 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f283613a-376b-4a02-b0a5-b7258c815a84 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:47.436348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f283613a-376b-4a02-b0a5-b7258c815a84 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1242 microversion: 2.1 time: 0.063216 May 09 18:31:47.436940 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 117/231] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:47 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:48.077525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:48.078225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:48.085787 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.086366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.087153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.087668 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.303517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:48.313169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cdca0b6f-64ce-47d5-94c6-f6b3e1450984 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1271 microversion: 2.1 time: 0.240702 May 09 18:31:48.313934 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 115/232] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:48 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:48.315797 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:48.316427 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:48.323440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.323845 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.324629 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.325074 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.453326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:48.454317 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:48.460774 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.461470 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.462470 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.463237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.575034 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:48.588349 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-50cbf0bb-0c12-4600-832c-7bf5ef3f570e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1294 microversion: 2.1 time: 0.139056 May 09 18:31:48.589648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 116/233] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:48 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1294 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:48.593431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:48.601795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ffdf6063-03ba-4e04-a900-eee45e970c0d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.289781 May 09 18:31:48.601936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-347b32d2-48c1-4583-bc88-631d1771bed0 req-1d5950e3-7f35-43ab-917d-cd3b1f7040fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8243cbea-6bde-4ac9-8f5a-53ec888ed813", "tag": "c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:48.610277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 118/234] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:48 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:48.611968 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-347b32d2-48c1-4583-bc88-631d1771bed0 req-1d5950e3-7f35-43ab-917d-cd3b1f7040fd service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:48.613120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-347b32d2-48c1-4583-bc88-631d1771bed0 req-1d5950e3-7f35-43ab-917d-cd3b1f7040fd service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:48.627723 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-347b32d2-48c1-4583-bc88-631d1771bed0 req-1d5950e3-7f35-43ab-917d-cd3b1f7040fd service nova] Creating event network-changed:c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c for instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 on hv-cinder-84112 May 09 18:31:48.637296 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-347b32d2-48c1-4583-bc88-631d1771bed0 req-1d5950e3-7f35-43ab-917d-cd3b1f7040fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038635 May 09 18:31:48.638144 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 117/235] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:49.329791 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:49.330345 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:49.337857 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.338414 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.339239 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.339879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.581166 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:49.591793 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a86c2a5a-1622-4143-ac5c-7d9cc0a012d9 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1271 microversion: 2.1 time: 0.265853 May 09 18:31:49.593225 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 119/236] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:49 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:49.609577 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:49.611283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:49.620538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.621001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.621788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.622237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.627364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:49.627573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:49.641431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.642163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.645010 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:49.647019 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:49.975956 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:49.979028 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:49.984370 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3b0652bd-771c-4bf8-9e9b-b60c63c95ab7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.368347 May 09 18:31:49.984952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 120/237] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:49 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:49.987407 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5a682ed6-e288-42d2-a35f-eb6a5c37317e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.384621 May 09 18:31:49.988259 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 118/238] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:49 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:50.608405 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:50.609127 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:50.615489 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.615969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.616748 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.617194 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.655621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-8e820812-84b4-488e-aba6-b8ef5ae9f0e1 req-77c4855b-575f-4487-9a5b-26bbff6b42c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b90383-7829-430d-ba18-361f2ef96634", "tag": "c3f65dac-7ea9-4b15-b33e-a6d90602c869"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:50.664242 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8e820812-84b4-488e-aba6-b8ef5ae9f0e1 req-77c4855b-575f-4487-9a5b-26bbff6b42c2 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:50.664699 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8e820812-84b4-488e-aba6-b8ef5ae9f0e1 req-77c4855b-575f-4487-9a5b-26bbff6b42c2 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:50.701972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-8e820812-84b4-488e-aba6-b8ef5ae9f0e1 req-77c4855b-575f-4487-9a5b-26bbff6b42c2 service nova] Creating event network-changed:c3f65dac-7ea9-4b15-b33e-a6d90602c869 for instance 79b90383-7829-430d-ba18-361f2ef96634 on hv-cinder-84112 May 09 18:31:50.707136 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-8e820812-84b4-488e-aba6-b8ef5ae9f0e1 req-77c4855b-575f-4487-9a5b-26bbff6b42c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055124 May 09 18:31:50.707837 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 119/239] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:31:50.850644 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:50.858430 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e9c9a5dc-bdb1-4ffc-8df8-80bb528494a0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1271 microversion: 2.1 time: 0.253804 May 09 18:31:50.859012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 121/240] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:50 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:51.008646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:51.009312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:51.011062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:51.011785 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:51.026861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.027489 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.029519 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.029904 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.030474 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.030947 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.034570 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.035009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.307361 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:51.312181 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:51.314833 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-779c4797-8d7b-4512-8b5a-95a4fbba3a94 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.314444 May 09 18:31:51.315516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 122/241] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:50 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:51.319455 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a40a4798-c0f8-4837-98e9-0bc00385257d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.320980 May 09 18:31:51.320011 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 120/242] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:50 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:51.875665 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:51.876517 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:51.882726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.883322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:51.884182 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:51.885272 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.015996 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:52.024382 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c96fc32f-c5fc-4ac4-bb51-583a6699882f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.152634 May 09 18:31:52.025064 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:51 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:52.334737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:52.335330 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:52.336952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:52.337848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:52.344643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.344643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.345439 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.345943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.346344 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.346996 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.348053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:52.348719 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:52.629514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:52.634466 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:52.638042 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-64d97742-e118-4618-80e3-dd09c926c842 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.309656 May 09 18:31:52.638967 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 121/244] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:52 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:52.642728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-939ff297-a6fd-4ba2-98fb-fcb1f21ea148 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.310533 May 09 18:31:52.643629 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 124/245] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:52 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:53.044125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:53.044747 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:53.051713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.052173 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.052941 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.053384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.179529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:53.187321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-20b112e5-6575-43ad-87d3-faa9077cc9d7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.147050 May 09 18:31:53.187882 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 122/246] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:53 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:53.653612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:53.654309 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:53.659854 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:53.660474 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:53.661362 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.661914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.662798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.663393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.667301 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.667806 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.668542 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:53.668993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:53.851498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:53.858445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:53.859367 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-89912fa3-5b0d-437e-9570-233e35c3ee6a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.203318 May 09 18:31:53.859952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 123/247] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:53 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:53.866412 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b773e634-ee39-4c16-9fa4-0c4dc935a3a8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.216649 May 09 18:31:53.866974 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 125/248] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:53 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:54.204236 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:54.204861 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:54.210737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.211227 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.212008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.212467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.339310 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:54.346499 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a2cf973e-ca6a-4f85-b568-a6a339bb8b71 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.146155 May 09 18:31:54.347069 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 124/249] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:54 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:54.876389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:54.877006 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:54.882693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:54.883312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.883472 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:54.883774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.885221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.885666 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.890285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.890754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:54.891562 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:54.892014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:55.069995 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:55.074791 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:55.078142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aa902c84-b490-449b-9ed2-5af1bcd0fbe4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.198986 May 09 18:31:55.078893 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 125/250] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:54 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:55.083207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3c425869-6ff7-43e1-a09b-248167e24549 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.210733 May 09 18:31:55.083771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 126/251] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:54 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:55.363678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:55.364305 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:55.370830 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:55.371321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:55.373395 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:55.373395 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:55.520726 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:55.528871 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8376b1e0-ccb3-466b-bd91-ae715c35d9ce tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.169019 May 09 18:31:55.529429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 126/252] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:55 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:56.094618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:56.095278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:56.099625 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:56.100252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:56.101663 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.102440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.103275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.103732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.108351 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.108833 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.109731 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.110200 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.296161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:56.299259 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:56.305058 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3a234fba-51d5-470d-aec7-07036aa9ee53 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.214366 May 09 18:31:56.305778 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 127/253] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:56 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:56.307322 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5765cb7d-4bf2-448e-b4e6-801356f34dc7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.211414 May 09 18:31:56.308019 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 127/254] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:56 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:56.545650 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:56.546417 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:56.552691 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.553226 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.554271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:56.555219 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:56.685387 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:56.692528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7dddf1ee-4cd5-4a04-9ea0-b3d0b49ea5a1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.150719 May 09 18:31:56.693096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 128/255] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:56 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:57.322276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:57.323440 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:57.324345 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:57.324978 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:57.331198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.331632 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.332412 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.332901 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.334413 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.334873 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.335712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.336156 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.524397 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:57.528271 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:57.533421 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c6195f4d-4918-44e8-8a8f-1f1f9c798afc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.213310 May 09 18:31:57.534156 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 129/256] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:57 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:57.543615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d06b822c-49b9-4c71-96f9-67cee5d17f91 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.224576 May 09 18:31:57.544208 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 128/257] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:57 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:57.708504 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:57.709044 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:57.715520 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.715974 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:57.716768 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:57.717190 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.087822 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:58.097475 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-84d6ba6f-730e-4414-aff5-8469c96fcfbc tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.392483 May 09 18:31:58.098232 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 130/258] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:57 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:58.165228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-0a3d865e-089b-40db-886a-1d87b4a53713 req-f3f63f18-b799-4923-8f0c-2b46927298ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b90383-7829-430d-ba18-361f2ef96634", "name": "network-vif-plugged", "status": "completed", "tag": "c3f65dac-7ea9-4b15-b33e-a6d90602c869"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:31:58.175388 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0a3d865e-089b-40db-886a-1d87b4a53713 req-f3f63f18-b799-4923-8f0c-2b46927298ae service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.175851 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0a3d865e-089b-40db-886a-1d87b4a53713 req-f3f63f18-b799-4923-8f0c-2b46927298ae service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.191272 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-0a3d865e-089b-40db-886a-1d87b4a53713 req-f3f63f18-b799-4923-8f0c-2b46927298ae service nova] Creating event network-vif-plugged:c3f65dac-7ea9-4b15-b33e-a6d90602c869 for instance 79b90383-7829-430d-ba18-361f2ef96634 on hv-cinder-84112 May 09 18:31:58.196380 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-0a3d865e-089b-40db-886a-1d87b4a53713 req-f3f63f18-b799-4923-8f0c-2b46927298ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034882 May 09 18:31:58.196990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 129/259] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:31:58.550213 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:58.550864 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:58.559708 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.560306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.561158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.561668 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.563840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:58.567216 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:58.571883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.572349 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.573273 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:58.573711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:58.752351 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:58.755489 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:58.759967 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1e121331-88fe-4bfa-b0f4-a44faf1b111c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.213933 May 09 18:31:58.760706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 131/260] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:58 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:58.762915 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7a6ffb6a-4b35-4b11-ac9f-32e911bce2f6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.207184 May 09 18:31:58.763509 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 130/261] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:58 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:31:59.114373 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:59.114922 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:59.120717 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.121177 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.121948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.122390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.249874 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:59.257359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-598b4166-8a8a-4362-a8a6-19d52a743301 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.147089 May 09 18:31:59.257921 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 132/262] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:59 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:59.776794 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:59.777530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:59.779483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:31:59.780112 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:31:59.783831 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.784301 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.785077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.785527 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.786346 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.786806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.787613 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:31:59.788059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:31:59.981034 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:59.983884 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:31:59.990481 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-abf39241-6276-40ce-aa41-1054a0c9cfec tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.217497 May 09 18:31:59.991502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 131/263] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:59 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:31:59.991635 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6f1506d0-ac07-4e74-8624-3ecc196c6ad8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.215883 May 09 18:31:59.999473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 133/264] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:31:59 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:00.132525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5716b12b-ff13-4ba6-ada9-117b896ae4d6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:00.138924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5716b12b-ff13-4ba6-ada9-117b896ae4d6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.139485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5716b12b-ff13-4ba6-ada9-117b896ae4d6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.207269 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5716b12b-ff13-4ba6-ada9-117b896ae4d6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Going to try to stop instance {{(pid=117088) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 18:32:00.252612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5716b12b-ff13-4ba6-ada9-117b896ae4d6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action" status: 202 len: 0 microversion: 2.1 time: 0.124573 May 09 18:32:00.253217 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 132/265] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:32:00 2022] POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:32:00.261297 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:00.261928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:00.267669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.268142 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.269068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.269677 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.274961 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:00.276233 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:00.282332 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.283001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.283811 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:00.284419 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:00.468886 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:00.472261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:00.476945 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7da4bd6b-b82d-493e-ada8-4ebf9a4a3b04 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.219476 May 09 18:32:00.477523 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 134/266] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:00 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:00.479662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-51f5f6b4-0bbc-4f40-bb52-5484702f183b tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.208861 May 09 18:32:00.480233 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 133/267] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:00 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:01.008091 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:01.008848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:01.009710 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:01.010128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:01.016197 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.016651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.017561 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.017958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.018193 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.018550 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.019564 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.020081 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.216750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:01.225588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:01.227444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5220a816-f3be-4445-abc1-581147db9d5c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.223106 May 09 18:32:01.228660 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 135/268] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:01 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:01.234278 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c9ade10c-d6ad-44a0-b8c4-a83a086343bf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1368 microversion: 2.1 time: 0.228603 May 09 18:32:01.235879 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 134/269] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:01 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:01.494056 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:01.494708 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:01.496369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:01.496803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:01.501020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.501484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.502265 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.502722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.502834 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.503275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.504138 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:01.504590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:01.694600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:01.703241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b3d0ec3c-4eba-4bd4-b71a-a51f3b7fcd9a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.213184 May 09 18:32:01.703489 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:01.703904 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 136/270] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:01 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:01.711571 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-59759d1a-e62b-4fd6-868a-828a774167d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.219226 May 09 18:32:01.712136 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 135/271] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:01 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:02.245597 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.246227 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.253434 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.253859 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.254316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.254672 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.255117 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.255606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.263156 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.263994 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.264991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.265661 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.453276 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:02.464826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1f3cb187-13a8-4b68-a7bf-cec217c3415a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1502 microversion: 2.1 time: 0.221921 May 09 18:32:02.466052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 137/272] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:02.470362 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:02.480064 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-085e4dc1-9320-458d-b493-4d2827bd0489 req-9d9fe9b7-ec7d-4ef2-a513-2275639e45de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8243cbea-6bde-4ac9-8f5a-53ec888ed813", "name": "network-vif-plugged", "status": "completed", "tag": "c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:02.481462 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-94388a63-ed1c-45ef-a305-b51a9f43b441 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1558 microversion: 2.1 time: 0.232943 May 09 18:32:02.482055 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 136/273] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:02.488443 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f325c7d-339b-43be-a079-0301989d6ba3"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:02.489900 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.493950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-085e4dc1-9320-458d-b493-4d2827bd0489 req-9d9fe9b7-ec7d-4ef2-a513-2275639e45de service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.494622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-085e4dc1-9320-458d-b493-4d2827bd0489 req-9d9fe9b7-ec7d-4ef2-a513-2275639e45de service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.501052 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.501703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.503502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.504615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.508971 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-085e4dc1-9320-458d-b493-4d2827bd0489 req-9d9fe9b7-ec7d-4ef2-a513-2275639e45de service nova] Creating event network-vif-plugged:c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c for instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 on hv-cinder-84112 May 09 18:32:02.518827 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-085e4dc1-9320-458d-b493-4d2827bd0489 req-9d9fe9b7-ec7d-4ef2-a513-2275639e45de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046852 May 09 18:32:02.519990 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 138/274] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:02.525167 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-40e74383-cb87-43a2-a586-e5d5db670305 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.525757 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-40e74383-cb87-43a2-a586-e5d5db670305 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.532409 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40e74383-cb87-43a2-a586-e5d5db670305 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.532866 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40e74383-cb87-43a2-a586-e5d5db670305 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.533644 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40e74383-cb87-43a2-a586-e5d5db670305 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.534089 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40e74383-cb87-43a2-a586-e5d5db670305 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.536895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] HTTP exception thrown: Cannot 'attach_volume' instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 while it is in vm_state rescued May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Request method failure captured: May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: POST /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51/os-volume_attachments HTTP/1.1 May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 74 May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2kHVKHC70jbdtlqcLtqCx7g8VL5Ug9a38m55Hd4sd7xI_aKp02cfltlH8kw6KHcPBWVNk_QCErJ0e4HWOjTcdH2NE1e3exEo9xfCwZYUBGt44Ky1nFiqcOLtH0XYYWol2eIWyOxRXndYcydWBN4_V5euBVPzJagYjI7UZEWWpXOsM May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:32:02.538883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_705eecf37fcc4fe7aabef923ece6ad59"}]}] May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: acae3ad19a7e45b9877520dff8f5b995 May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {"volumeAttachment": {"volumeId": "9f325c7d-339b-43be-a079-0301989d6ba3"}} May 09 18:32:02.540660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Cannot 'attach_volume' instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 while it is in vm_state rescued May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'server_id': '5e67e009-eec8-48f1-b8ec-5ba755aeba51', 'body': {'volumeAttachment': {'volumeId': '9f325c7d-339b-43be-a079-0301989d6ba3'}}} May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:32:02.541408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 while it is in vm_state rescued May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:02.542582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:02.543664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:32:02.543664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:32:02.543664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 while it is in vm_state rescued May 09 18:32:02.543664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:02.545399 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Returning 409 to user: Cannot 'attach_volume' instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 while it is in vm_state rescued {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:32:02.546484 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bc695709-ef9a-4ab3-a769-e16baf402af6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063360 May 09 18:32:02.547304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 137/275] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:32:02 2022] POST /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 18:32:02.558740 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-45a561e3-13c5-4d74-95db-47abd91874a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:02.559627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-45a561e3-13c5-4d74-95db-47abd91874a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.566204 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45a561e3-13c5-4d74-95db-47abd91874a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.566776 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45a561e3-13c5-4d74-95db-47abd91874a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.567835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45a561e3-13c5-4d74-95db-47abd91874a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.568585 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45a561e3-13c5-4d74-95db-47abd91874a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.640819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-40e74383-cb87-43a2-a586-e5d5db670305 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119862 May 09 18:32:02.641409 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 139/276] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:02.692988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-45a561e3-13c5-4d74-95db-47abd91874a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51/action" status: 202 len: 0 microversion: 2.1 time: 0.139486 May 09 18:32:02.694526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 138/277] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:32:02 2022] POST /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:32:02.702619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.703484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.709785 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.710497 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.711476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.712083 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.721804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:02.722488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:02.737128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.737624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:02.738428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:02.738876 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.039042 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:03.047649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c22749ec-40dd-4c6b-814f-2b885de0f3ab tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.349240 May 09 18:32:03.050757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:03.056519 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 140/278] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:03.062226 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:03.063008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:03.065955 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-06079175-ce49-41f7-a658-4bb9a01f7fbf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.348352 May 09 18:32:03.066723 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 139/279] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:02 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:03.072730 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.073760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.074576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:03.075011 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:03.324241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:03.333634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1b5ab2ce-3be2-4eaa-a266-17c68a67ba1f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.275859 May 09 18:32:03.343589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 141/280] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:03 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:04.062031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-332543f7-00ce-4611-9975-b6addb760c8e req-2d49e848-ff6c-481a-934f-b73bce8e3872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b90383-7829-430d-ba18-361f2ef96634", "tag": "c3f65dac-7ea9-4b15-b33e-a6d90602c869"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:04.070288 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-332543f7-00ce-4611-9975-b6addb760c8e req-2d49e848-ff6c-481a-934f-b73bce8e3872 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.074415 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:04.074996 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-332543f7-00ce-4611-9975-b6addb760c8e req-2d49e848-ff6c-481a-934f-b73bce8e3872 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.075217 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:04.084827 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.085380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.086459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.088315 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.094001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-332543f7-00ce-4611-9975-b6addb760c8e req-2d49e848-ff6c-481a-934f-b73bce8e3872 service nova] Creating event network-changed:c3f65dac-7ea9-4b15-b33e-a6d90602c869 for instance 79b90383-7829-430d-ba18-361f2ef96634 on hv-cinder-84112 May 09 18:32:04.099292 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-332543f7-00ce-4611-9975-b6addb760c8e req-2d49e848-ff6c-481a-934f-b73bce8e3872 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040686 May 09 18:32:04.100525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 140/281] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:04.106516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:04.107581 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:04.115326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.116006 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.117021 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.117939 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.315666 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:04.324192 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a6e630e5-1cc0-4c7c-89a4-f880e8f0d39d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.254149 May 09 18:32:04.325946 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 142/282] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:04 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:04.350278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:04.351149 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:04.362305 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.364223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.365223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:04.366755 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:04.403632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:04.411906 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2b762a38-40c7-44a7-a561-e12a577f08aa tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.310073 May 09 18:32:04.421844 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 141/283] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:04 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:04.549389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:04.560355 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4f84b1cb-c0c8-49d4-818d-e5a8590498bd tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.214196 May 09 18:32:04.563865 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 143/284] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:04 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:05.346982 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:05.348366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:05.355593 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.356058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.356847 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.357296 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.429711 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:05.430964 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:05.440720 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.441427 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.442439 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.442917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.500151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:05.509094 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-eff8911c-1426-4dfa-9c61-59791d3be5f0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.170132 May 09 18:32:05.510015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 142/285] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:05 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:05.579647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:05.580343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:05.587468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.588078 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.589659 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:05.590241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:05.605096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:05.617692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8fcc8f77-65be-4194-85e6-6caa5dce86a3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.192077 May 09 18:32:05.627805 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 144/286] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:05 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:05.784298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:05.792975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ba585717-649d-42d8-8f49-9429d4fde656 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1259 microversion: 2.1 time: 0.217375 May 09 18:32:05.793540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 143/287] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:05 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:06.527331 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:06.527973 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:06.534175 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.534620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.535415 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.535858 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.635634 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:06.636320 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:06.642166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.642823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.643714 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.644164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.670771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:06.678028 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0d1f7210-23e3-40b7-9637-452a80afe2b0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.154556 May 09 18:32:06.678603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 145/288] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:06 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:06.772256 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:06.780963 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f101ac9b-d163-4abd-b4a8-2c18a5de435a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.149515 May 09 18:32:06.781539 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 144/289] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:06 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:06.809635 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:06.810254 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:06.816024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.816479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.817244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.817683 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.944261 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:06.951696 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bc37d9c5-0060-4324-89b3-346ed7b2ce2a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1442 microversion: 2.1 time: 0.145866 May 09 18:32:06.952267 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 146/290] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:06 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1442 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:06.968512 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:06.969129 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:06.974977 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.975467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:06.976267 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:06.976711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.100754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:07.108007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-72b9ef5f-2241-40d3-905a-f1f1393cb66a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1442 microversion: 2.1 time: 0.143368 May 09 18:32:07.108572 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 145/291] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:06 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1442 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:07.695392 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:07.696025 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:07.702924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.703425 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.704215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.704695 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.799570 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:07.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:07.806798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.807930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.808782 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:07.809302 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:07.945475 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:07.952921 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6b0b6648-72ae-4041-a182-0a84db510f45 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.261572 May 09 18:32:07.953585 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 147/292] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:07 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:08.027528 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:08.035387 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7543e11e-4746-4fe4-994f-7fa25532b9a6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.240663 May 09 18:32:08.036279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 146/293] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:07 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:08.969831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:08.970629 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:08.977072 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.977618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:08.978454 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:08.978972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.053580 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:09.054212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:09.061838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.062410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.063311 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.063829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.247716 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:09.255673 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4eeb5a3d-8e09-494a-9d38-aa45b66d6ab5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.289653 May 09 18:32:09.256251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 148/294] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:08 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:09.296776 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:09.304659 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3a1b5122-6be2-4279-8716-827824aec4b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.255001 May 09 18:32:09.314745 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 147/295] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:09 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:09.341413 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-791b301f-73f1-40b4-b24d-59f7a5428f20 req-464cea60-65aa-4d9b-8258-ca3dd68322d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8243cbea-6bde-4ac9-8f5a-53ec888ed813", "tag": "c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:09.350091 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-791b301f-73f1-40b4-b24d-59f7a5428f20 req-464cea60-65aa-4d9b-8258-ca3dd68322d9 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:09.350544 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-791b301f-73f1-40b4-b24d-59f7a5428f20 req-464cea60-65aa-4d9b-8258-ca3dd68322d9 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:09.362732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-791b301f-73f1-40b4-b24d-59f7a5428f20 req-464cea60-65aa-4d9b-8258-ca3dd68322d9 service nova] Creating event network-changed:c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c for instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 on hv-cinder-84112 May 09 18:32:09.368185 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-791b301f-73f1-40b4-b24d-59f7a5428f20 req-464cea60-65aa-4d9b-8258-ca3dd68322d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030434 May 09 18:32:09.368821 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 149/296] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:10.272512 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:10.273149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:10.279927 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.280398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.281192 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.281647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.323527 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:10.324915 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:10.339906 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.340738 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.341798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.342458 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.483134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:10.490427 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cfbe1d7c-308f-4a77-94fd-ee4cf3dd1174 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.221707 May 09 18:32:10.490993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 148/297] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:10 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:10.567862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:10.579012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a961ccf3-db15-4b04-9105-1e8aea408549 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.260567 May 09 18:32:10.579961 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 150/298] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:10 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:10.602594 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-96680481", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:10.651477 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] validate_networks() for None {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:32:10.917112 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:32:10.917540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:32:10.918023 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:32:10.918436 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:32:10.918852 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:32:10.927397 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.927857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.928673 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:10.929118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:10.945463 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Getting quotas for project 366da93a37f54180a7c2226d90a2356d. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:32:10.949449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Getting quotas for user 4dfc640ee055498e9af6151c5d3320d8 and project 366da93a37f54180a7c2226d90a2356d. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:32:10.960064 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:32:10.962294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:32:11.006114 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6033671f-5b5e-4201-b224-ab366ca3549b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.407326 May 09 18:32:11.006755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 149/299] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:32:11.016646 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6f0d9997-e3e9-4d20-83ce-ea4de234abe7 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:11.017383 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6f0d9997-e3e9-4d20-83ce-ea4de234abe7 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:11.068977 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6f0d9997-e3e9-4d20-83ce-ea4de234abe7 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:11.075748 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6f0d9997-e3e9-4d20-83ce-ea4de234abe7 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1213 microversion: 2.1 time: 0.062960 May 09 18:32:11.076318 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 151/300] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:11 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:11.508517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:11.509346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:11.517193 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.517610 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.518313 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.518740 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.596627 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:11.597365 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:11.604082 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.604615 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.605464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:11.605980 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:11.658611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:11.665988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-34b82d00-2ea6-497e-bcd4-eee78db35c08 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.161832 May 09 18:32:11.666608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 150/301] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:11 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:11.737764 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:11.745568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1b525614-2a76-4b2e-a18b-a6baf35a8dc4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.152825 May 09 18:32:11.746133 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 152/302] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:11 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:12.092691 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:12.093314 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:12.099275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.099732 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.100496 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.100937 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.159640 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:12.166722 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-31a085eb-efab-42b2-a416-1a6085a5ddfe tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1217 microversion: 2.1 time: 0.077859 May 09 18:32:12.167321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 151/303] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:12 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:12.683742 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:12.684287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:12.690595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.691057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.691866 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.692313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.762612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:12.763252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:12.769419 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.769875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.770647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:12.771112 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:12.847202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:12.854460 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-efffa424-b296-4cb1-ad64-20c81e8ebb0f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.175184 May 09 18:32:12.855030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 153/304] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:12 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:12.907376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:12.915044 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0c9856ab-471f-42cf-9a8a-8fb0ccc30529 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.156929 May 09 18:32:12.915667 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 152/305] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:12 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:13.182968 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:13.183611 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:13.189476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.189934 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.190697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.191143 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.252663 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:13.259817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ac3c276a-cdf1-4c53-868b-e9b76f274d0d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1217 microversion: 2.1 time: 0.081326 May 09 18:32:13.260386 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 154/306] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:13 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:13.872026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:13.872583 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:13.879039 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.879531 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.880297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.880739 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.932454 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:13.933133 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:13.939428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.940263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:13.941123 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:13.941639 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.048486 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:14.063770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c9fd4f0c-14c4-46f0-81cc-379e1a196938 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1510 microversion: 2.1 time: 0.195579 May 09 18:32:14.074388 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 153/307] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:13 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:14.112795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:14.122865 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-05d6c4bd-4283-433d-9ff3-f660219afb90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.194128 May 09 18:32:14.123408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 155/308] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:13 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:14.276482 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:14.277114 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:14.283298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:14.283765 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.284540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:14.284988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:14.357012 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:14.364331 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8b59851c-eaac-48ff-a0a5-560bbf10b458 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1217 microversion: 2.1 time: 0.091895 May 09 18:32:14.364928 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 154/309] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:14 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:15.081799 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:15.082421 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:15.089459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.089919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.090692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.091128 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.140409 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:15.141139 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:15.147588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.148057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.148840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.149293 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.256898 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:15.265099 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-58722a5f-d4e8-452b-a137-f844066362c6 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1516 microversion: 2.1 time: 0.187118 May 09 18:32:15.265678 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 156/310] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:15 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:15.304318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:15.312039 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7e196103-cc1c-41b5-a6c6-39d034deb597 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.175505 May 09 18:32:15.312606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 155/311] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:15 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:15.381821 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:15.382443 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:15.388732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.389185 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.389962 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:15.390401 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:15.453357 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:15.461172 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7c7cbc83-306c-4102-a35a-878614d09a14 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1273 microversion: 2.1 time: 0.083056 May 09 18:32:15.462100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 157/312] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:15 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:16.329152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:16.329758 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:16.336011 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:16.336472 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.337234 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:16.337678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.460952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:16.469131 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e5eca9e1-3480-4b7b-8ea6-de83fbdd2fdf tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.143821 May 09 18:32:16.469700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 156/313] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:16 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:16.478198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:16.479396 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:16.485691 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:16.486186 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.486967 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:16.487450 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:16.547336 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:16.554619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-77c28aef-b964-4b61-b509-b758125c1a6c tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1273 microversion: 2.1 time: 0.080226 May 09 18:32:16.555222 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 158/314] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:16 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1273 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:17.486193 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:17.486815 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:17.493143 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.493604 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.494883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.495353 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.571114 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:17.572123 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:17.578758 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.579246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.588260 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:17.588745 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:17.667696 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:17.676358 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cd78890e-d273-4451-a1b6-f8d73e14f034 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.193961 May 09 18:32:17.677012 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 157/315] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:17 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:17.678116 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:17.692546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a81add94-d1b0-4a1e-bb02-dd52d1fe3dd2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1273 microversion: 2.1 time: 0.125247 May 09 18:32:17.693273 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 159/316] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:17 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:18.695703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9a5a538c-bec9-4a40-afcc-beeb074f4dc3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'create', calling method: .version_select at 0x7f3f7f1eb670>, body: {"keypair": {"name": "tempest-keypair-702182038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpIIovaUa8vczbzDosoMzfcATSWRGX6T1JxKuI7oatEI9ejp8WTgmjoQvLXSpvdLAOmvaISNnjFZ+osONQo8iyOynGr84l3O4AdRPJFbvEInsI053e3oFUUfFWJn54sFg=="}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:18.696373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:18.696757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:18.704281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.704748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.705603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.706044 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.712882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-9a5a538c-bec9-4a40-afcc-beeb074f4dc3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:32:18.717100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-9a5a538c-bec9-4a40-afcc-beeb074f4dc3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for user acae3ad19a7e45b9877520dff8f5b995 and project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:32:18.749228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9a5a538c-bec9-4a40-afcc-beeb074f4dc3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057579 May 09 18:32:18.750220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 160/317] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:32:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:32:18.755587 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:18.756688 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:18.763458 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.764025 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:18.764921 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:18.765610 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:19.106115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:19.109840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:19.119235 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7bc310a8-aae1-4441-b862-e1590211921a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.367509 May 09 18:32:19.120327 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 161/318] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:18 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:19.127909 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a11ca26a-3328-47f8-8ebc-3e74eab2b9e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.437056 May 09 18:32:19.131776 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 158/319] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:18 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:19.642647 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-633737e9-8ba9-420f-81ea-ee5508a6deb3 req-bd96f3e3-c20f-45ba-a2f3-86f12f61caf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d589e885-2446-4a24-8bf1-6fc302a5746d", "tag": "72826bc3-b8ba-4b4b-8df5-a56b997a76f1"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:19.675754 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-633737e9-8ba9-420f-81ea-ee5508a6deb3 req-bd96f3e3-c20f-45ba-a2f3-86f12f61caf6 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:19.676538 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-633737e9-8ba9-420f-81ea-ee5508a6deb3 req-bd96f3e3-c20f-45ba-a2f3-86f12f61caf6 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:19.703447 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-633737e9-8ba9-420f-81ea-ee5508a6deb3 req-bd96f3e3-c20f-45ba-a2f3-86f12f61caf6 service nova] Creating event network-changed:72826bc3-b8ba-4b4b-8df5-a56b997a76f1 for instance d589e885-2446-4a24-8bf1-6fc302a5746d on hv-cinder-84112 May 09 18:32:19.718243 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-633737e9-8ba9-420f-81ea-ee5508a6deb3 req-bd96f3e3-c20f-45ba-a2f3-86f12f61caf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084896 May 09 18:32:19.718875 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 162/320] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:20.144868 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:20.145428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:20.146187 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:20.146820 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:20.152985 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.153445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.154226 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.154659 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.156476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.157410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.158459 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.159126 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.347905 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:20.350780 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:20.355931 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ed914c87-1e5f-4b53-813b-d32c7a3a18d7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.215349 May 09 18:32:20.356510 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 163/321] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:20 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:20.358390 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f5f506d8-bf15-459a-9dd1-5452d159d41e tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.224013 May 09 18:32:20.358958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 159/322] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:20 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:20.361756 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2108277001", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bd4c030-c4c5-476b-9935-9aed7888eb95"}], "security_groups": [{"name": "tempest-securitygroup--605583813"}], "key_name": "tempest-keypair-702182038", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:20.457320 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] validate_networks() for [('6bd4c030-c4c5-476b-9935-9aed7888eb95', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:32:20.816169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:32:20.816767 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:32:20.817069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:32:20.817517 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:32:20.817938 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:32:20.826541 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.826998 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.827851 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:20.828302 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:20.844305 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:32:20.848130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Getting quotas for user acae3ad19a7e45b9877520dff8f5b995 and project 705eecf37fcc4fe7aabef923ece6ad59. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:32:20.859280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:32:20.861539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:32:20.906301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-784c4178-4717-4471-b502-8f3f297cce91 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.548724 May 09 18:32:20.906870 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 164/323] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:32:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:32:20.917578 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7401c981-14ef-4bfb-a6cf-8781cf200077 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:20.918202 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7401c981-14ef-4bfb-a6cf-8781cf200077 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:20.972655 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7401c981-14ef-4bfb-a6cf-8781cf200077 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:20.979693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7401c981-14ef-4bfb-a6cf-8781cf200077 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1245 microversion: 2.1 time: 0.066053 May 09 18:32:20.980253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 160/324] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:20 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:21.373687 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:21.374314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:21.374427 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:21.375000 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:21.380673 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.381136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.381928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.382035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.382377 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.382489 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.383157 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:21.383626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:21.569105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:21.573779 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:21.577697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-56e4616c-1bce-4309-83fa-63297c33c8f0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.208493 May 09 18:32:21.578391 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 165/325] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:21 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:21.581079 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-da1e3ffa-14f7-448e-9e92-9d451513952b tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.210462 May 09 18:32:21.581659 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 161/326] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:21 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:21.997278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:21.997898 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.003957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.004412 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.005175 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.005614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.072061 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:22.079271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-45990989-1a8b-41c1-a3e8-dc7f05733f17 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1297 microversion: 2.1 time: 0.086337 May 09 18:32:22.079815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 166/327] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:21 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:22.596289 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:22.596874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.602447 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:22.603329 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.603705 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.604620 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.605573 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.606178 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.614509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.616139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.617258 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.618162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.811507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:22.815257 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:22.819437 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d0ec334d-78f3-42ec-9d70-eebf8a42da8e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.228091 May 09 18:32:22.820025 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 162/328] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:22 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:22.823207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-be26acc5-bc0d-4239-a007-3ec74cb36e2d tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.228901 May 09 18:32:22.823813 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 167/329] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:22 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:22.866200 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9a8117c2-8817-4c5c-a447-620680c7bcc7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:22.866636 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9a8117c2-8817-4c5c-a447-620680c7bcc7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:22.872582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a8117c2-8817-4c5c-a447-620680c7bcc7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.873043 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a8117c2-8817-4c5c-a447-620680c7bcc7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.873820 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a8117c2-8817-4c5c-a447-620680c7bcc7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:22.874268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a8117c2-8817-4c5c-a447-620680c7bcc7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:22.897319 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9a8117c2-8817-4c5c-a447-620680c7bcc7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/ips" status: 200 len: 150 microversion: 2.20 time: 0.034868 May 09 18:32:22.898502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 163/330] 10.222.0.25 () {60 vars in 1288 bytes} [Mon May 9 18:32:22 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:32:23.095360 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:23.096716 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:23.104164 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.105855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:23.107039 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.107737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:23.183888 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:23.193215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-de553e4d-b89c-4961-b6f1-16b381a95ca2 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1303 microversion: 2.1 time: 0.101588 May 09 18:32:23.204303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 168/331] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:23 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:23.837708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:23.838698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:23.839852 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:23.840486 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:23.845924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.846565 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:23.847274 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.847493 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.847760 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:23.848022 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:23.848790 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:23.849252 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.085035 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:24.089980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:24.096068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-055f7026-61c0-4179-9c41-27a61d7df6b4 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.260161 May 09 18:32:24.099216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 169/332] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:23 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:24.111626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2107b307-4179-4b26-810b-5c89fca66d90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.278286 May 09 18:32:24.112712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 164/333] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:23 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:24.129573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-3ab6d947-c6d9-4075-b3df-11f4fe4a8cb1 req-049310ae-9043-4a43-a584-c225e3c56510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a3f8d9-8713-420a-8b24-b30d90e869b6", "tag": "3976c86a-41ed-4aae-b61d-e0d4b31b0fa3"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:24.138057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3ab6d947-c6d9-4075-b3df-11f4fe4a8cb1 req-049310ae-9043-4a43-a584-c225e3c56510 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:24.138511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3ab6d947-c6d9-4075-b3df-11f4fe4a8cb1 req-049310ae-9043-4a43-a584-c225e3c56510 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.149774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-3ab6d947-c6d9-4075-b3df-11f4fe4a8cb1 req-049310ae-9043-4a43-a584-c225e3c56510 service nova] Creating event network-changed:3976c86a-41ed-4aae-b61d-e0d4b31b0fa3 for instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 on hv-cinder-84112 May 09 18:32:24.155548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-3ab6d947-c6d9-4075-b3df-11f4fe4a8cb1 req-049310ae-9043-4a43-a584-c225e3c56510 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029990 May 09 18:32:24.156817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 170/334] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:24.215038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:24.216012 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:24.222525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:24.222980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.223788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:24.224405 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.380428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:24.388693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e849f6bf-95ca-4054-81cf-96beac170044 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.181357 May 09 18:32:24.389673 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 165/335] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:24 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:24.594427 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-e32c8d0b-9dea-440a-8b17-c55c9a0b2550 req-d526d1b6-7e46-4769-8a52-d948b4676ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d589e885-2446-4a24-8bf1-6fc302a5746d", "name": "network-vif-plugged", "status": "completed", "tag": "72826bc3-b8ba-4b4b-8df5-a56b997a76f1"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:24.606449 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e32c8d0b-9dea-440a-8b17-c55c9a0b2550 req-d526d1b6-7e46-4769-8a52-d948b4676ec7 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:24.607212 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e32c8d0b-9dea-440a-8b17-c55c9a0b2550 req-d526d1b6-7e46-4769-8a52-d948b4676ec7 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:24.621818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-e32c8d0b-9dea-440a-8b17-c55c9a0b2550 req-d526d1b6-7e46-4769-8a52-d948b4676ec7 service nova] Creating event network-vif-plugged:72826bc3-b8ba-4b4b-8df5-a56b997a76f1 for instance d589e885-2446-4a24-8bf1-6fc302a5746d on hv-cinder-84112 May 09 18:32:24.627750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-e32c8d0b-9dea-440a-8b17-c55c9a0b2550 req-d526d1b6-7e46-4769-8a52-d948b4676ec7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039080 May 09 18:32:24.629024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 171/336] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:25.116546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:25.117250 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:25.125080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.125816 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.126626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.127075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.130023 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:25.130734 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:25.138140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.138837 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.140313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.140766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.319188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.325770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.326962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-088a3030-908a-4f69-9c44-1a369d91a7c1 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.214362 May 09 18:32:25.327586 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 166/337] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:25 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:25.333489 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-724392d6-4134-4026-b8c9-f76aa9eec70e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.207951 May 09 18:32:25.334040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 172/338] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:25 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:25.405827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:25.406513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:25.412411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.412725 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:25.412875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.413264 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:25.413648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.414095 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.419491 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.419949 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.420718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.421158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.442866 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lazy-loading 'flavor' on Instance uuid 02b5c8d4-23e0-426a-806c-d472fcd826fb {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:32:25.543688 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.551142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-86e7ab5d-fb01-4cec-be67-0a3b674de67f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.149159 May 09 18:32:25.551731 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 167/339] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:25 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:25.707483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ff464557-203f-473b-8b48-19ebd25942c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/action" status: 202 len: 0 microversion: 2.20 time: 0.298423 May 09 18:32:25.708096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 173/340] 10.222.0.25 () {62 vars in 1318 bytes} [Mon May 9 18:32:25 2022] POST /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 09 18:32:25.716642 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:25.717267 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:25.723247 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.723714 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.724489 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:25.724935 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:25.847517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.855216 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.856741 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:25.857902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-59f1a246-3f38-4b27-80a3-fe1ad40de3c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.145555 May 09 18:32:25.858467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 168/341] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:25 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:26.344694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:26.345407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:26.349394 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:26.350041 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:26.351727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.352192 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.352972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.353421 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.356934 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.357393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.358160 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.358603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.539987 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:26.542913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:26.547249 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5cf8dc9d-df53-44cc-b89d-34f2c6630c76 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.207143 May 09 18:32:26.547823 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 174/342] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:26 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:26.551507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fa68a3fc-e0b2-4704-a15f-79a530262016 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.205823 May 09 18:32:26.552078 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 169/343] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:26 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:26.567658 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:26.568277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:26.574630 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.575092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.575908 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.576355 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.701237 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:26.708526 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-61da15a6-773e-4bf1-8e1e-c8031ca1559b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.144593 May 09 18:32:26.709103 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 175/344] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:26 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:26.876343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:26.876968 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:26.882873 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.883368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:26.884141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:26.884588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.056241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:27.064756 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:27.066285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:27.067482 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8f54cb23-c1a8-42f4-bc7e-927d58e90359 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.195286 May 09 18:32:27.068048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 170/345] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:26 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:27.563979 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:27.564607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:27.569424 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:27.570568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:27.570938 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:27.571445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.572227 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:27.572679 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.577182 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:27.577636 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.578593 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:27.579041 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.838936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:27.845276 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:27.846898 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-315aafa3-f3f3-4cdc-ade1-74a88d0c5e90 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.281226 May 09 18:32:27.852972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 171/346] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:27 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:27.852972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:27.853222 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cfd8ef18-d475-417b-b2af-3bd62ed219f5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1313 microversion: 2.1 time: 0.292460 May 09 18:32:27.853307 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:27.853384 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 176/347] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:27 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:27.866221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:27.866683 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.867509 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:27.867959 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:27.991500 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:27.999244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-52bc3835-bd71-49cb-9a58-a00cfbecb176 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.150610 May 09 18:32:27.999812 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 172/348] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:27 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:28.086129 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:28.086684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:28.092489 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.092946 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:28.093706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.094147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:28.220483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:28.228181 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:28.230227 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:28.231428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-90779a4b-7982-4078-866e-a21ba0101b23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.149195 May 09 18:32:28.232060 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 177/349] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:28 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:28.864988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:28.865631 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:28.869208 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:28.869830 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:28.872110 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.872574 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:28.873355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.873800 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:28.876202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.876869 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:28.877641 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:28.878086 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.067911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.071526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.077386 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2d934b0e-ffb6-4f9d-99f9-fce8b603f8c5 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1462 microversion: 2.1 time: 0.211886 May 09 18:32:29.089612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 178/350] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:28 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1462 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:29.089801 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7dac0f57-165a-4b42-84ec-951489ffdcd3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.219438 May 09 18:32:29.089801 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 173/351] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:28 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:29.092916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:29.093568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:29.099604 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.100065 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.100845 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.101287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.118253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:29.118766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:29.125223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.125959 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.126749 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.127211 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.153404 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:32:29.229577 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a1df947a-e810-4f66-854f-b08124d566df tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 204 len: 0 microversion: 2.1 time: 0.114857 May 09 18:32:29.230091 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 174/352] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:32:29 2022] DELETE /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 18:32:29.235048 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.239553 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:29.240297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:29.243612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cdc63c15-b1f9-47f9-91d7-9f3a3a068371 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.163139 May 09 18:32:29.247636 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.248090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.248872 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.249425 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.252707 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 179/353] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:29 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:29.257307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:29.257962 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:29.264882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.265326 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.266187 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:29.266632 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:29.446564 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.453501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.454917 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-844eddb4-3d46-4bd9-b9af-8a035d624928 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1468 microversion: 2.1 time: 0.220580 May 09 18:32:29.455533 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 175/354] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:29 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1468 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:29.461589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.463090 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:29.464301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e10d3d95-ff57-49a3-b282-bfd1ee92aa28 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.210720 May 09 18:32:29.464844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 180/355] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:29 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:30.099035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:30.099760 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:30.106648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.107104 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.107894 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.108342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.234132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:30.241934 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5a3b867a-7716-4ce6-8c0a-06570f6591a4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.146806 May 09 18:32:30.242506 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 176/356] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:30 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:30.260316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:30.260963 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:30.267280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.267745 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.268516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.268962 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.409017 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:30.416309 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2e70fd10-a41a-461d-8e9b-f93eddf61931 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.160258 May 09 18:32:30.416886 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 181/357] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:30 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:30.472223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:30.472874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:30.478520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.478980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.479783 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.480229 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.481958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:30.482604 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:30.488837 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.489316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.490248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.490605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.907825 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:30.914830 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:30.915428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-984a4eb9-3e2a-4437-94e2-9746f7fb64c2 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1468 microversion: 2.1 time: 0.447173 May 09 18:32:30.916007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 177/358] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:30 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1468 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:30.920465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-482ed694-d313-4aa8-bb55-e870a61f43be req-a187607a-d451-489a-b222-5e9e1d025478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a3f8d9-8713-420a-8b24-b30d90e869b6", "name": "network-vif-plugged", "status": "completed", "tag": "3976c86a-41ed-4aae-b61d-e0d4b31b0fa3"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:30.922771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:30.924290 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:30.925615 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8081f5f8-38a2-42d3-bdb6-b1e235796669 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.447840 May 09 18:32:30.926303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 182/359] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:30 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:30.928203 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-482ed694-d313-4aa8-bb55-e870a61f43be req-a187607a-d451-489a-b222-5e9e1d025478 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:30.928661 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-482ed694-d313-4aa8-bb55-e870a61f43be req-a187607a-d451-489a-b222-5e9e1d025478 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:30.939816 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-482ed694-d313-4aa8-bb55-e870a61f43be req-a187607a-d451-489a-b222-5e9e1d025478 service nova] Creating event network-vif-plugged:3976c86a-41ed-4aae-b61d-e0d4b31b0fa3 for instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 on hv-cinder-84112 May 09 18:32:30.944485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-482ed694-d313-4aa8-bb55-e870a61f43be req-a187607a-d451-489a-b222-5e9e1d025478 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027400 May 09 18:32:30.945051 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 178/360] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:31.259296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:31.259912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:31.266175 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.266746 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:31.267407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.267850 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:31.397273 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:31.405488 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-29231480-699a-45cb-a462-c64cfc75d942 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.150040 May 09 18:32:31.406050 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 183/361] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:31 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:31.433944 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:31.434644 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:31.440677 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.441129 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:31.441888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.442328 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:31.571257 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:31.578514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bbffb250-e202-4ab2-9d60-61a7fb939e4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.149200 May 09 18:32:31.579104 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 179/362] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:31 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:31.932391 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:31.933070 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:31.944029 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:31.944659 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:31.949299 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.949772 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:31.950571 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.951022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:31.953882 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.954351 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:31.955128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:31.955662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.233892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.236676 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.241601 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-aa297363-46b1-4e04-9004-a28a46f990f0 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1468 microversion: 2.1 time: 0.313083 May 09 18:32:32.242374 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 184/363] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:31 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:32.245748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.247335 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.248491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-368e4a40-c5c9-446e-9e54-4e362bf8eaee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.308266 May 09 18:32:32.249196 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 180/364] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:31 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:32.401562 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-997df934-5b6a-49f0-9942-1f0b924d731a req-60617489-dc93-4463-b03c-d127dcc06c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d589e885-2446-4a24-8bf1-6fc302a5746d", "name": "network-vif-deleted", "tag": "72826bc3-b8ba-4b4b-8df5-a56b997a76f1"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:32.410029 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-997df934-5b6a-49f0-9942-1f0b924d731a req-60617489-dc93-4463-b03c-d127dcc06c97 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.410473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-997df934-5b6a-49f0-9942-1f0b924d731a req-60617489-dc93-4463-b03c-d127dcc06c97 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.421759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-997df934-5b6a-49f0-9942-1f0b924d731a req-60617489-dc93-4463-b03c-d127dcc06c97 service nova] Creating event network-vif-deleted:72826bc3-b8ba-4b4b-8df5-a56b997a76f1 for instance d589e885-2446-4a24-8bf1-6fc302a5746d on hv-cinder-84112 May 09 18:32:32.422235 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:32.422870 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:32.426716 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-997df934-5b6a-49f0-9942-1f0b924d731a req-60617489-dc93-4463-b03c-d127dcc06c97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028747 May 09 18:32:32.427347 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 185/365] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:32.430076 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.430546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.431874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.432408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.559775 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.567581 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-46d9852f-f1f0-4e83-a894-901d5cfbaf1f tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.149623 May 09 18:32:32.568147 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 181/366] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:32 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:32.597168 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:32.597983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:32.605121 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.605586 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.606397 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:32.606848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:32.741612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:32.749735 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2fe3ad39-3841-4954-ac00-8ef90ce49b0e tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1370 microversion: 2.1 time: 0.157009 May 09 18:32:32.750552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 186/367] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:32 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:33.259128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:33.260276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:33.266148 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.266310 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:33.266608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.266841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:33.267396 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.267839 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.272598 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.273044 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.273806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.274242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.298172 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.298635 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.299092 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lazy-loading 'fault' on Instance uuid d589e885-2446-4a24-8bf1-6fc302a5746d {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:32:33.369432 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.376859 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e8e7e426-d125-4316-8812-aab12c455c28 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1303 microversion: 2.1 time: 0.121582 May 09 18:32:33.377660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 182/368] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:33 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:33.431603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.439204 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.440697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.441841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d5e671e3-ea9f-4f43-9e01-1f8816ed29b4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.179550 May 09 18:32:33.442394 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 187/369] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:33 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:32:33.585371 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:33.585985 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:33.593101 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.593561 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.594338 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.594782 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.731565 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.739442 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ed9dddae-f270-4028-958c-4c5577723783 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1724 microversion: 2.1 time: 0.158513 May 09 18:32:33.740033 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 183/370] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:33 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:33.767655 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:33.768275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:33.774336 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.774796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.775608 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.776057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.898125 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:33.905281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f49a224d-73be-44ea-b13d-11bd3696d8db tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1564 microversion: 2.1 time: 0.141381 May 09 18:32:33.905848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 188/371] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:33 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:33.921404 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-da4bc40a-0855-4153-afef-b7883afeca8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:33.921914 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-da4bc40a-0855-4153-afef-b7883afeca8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:33.927737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da4bc40a-0855-4153-afef-b7883afeca8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.928200 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da4bc40a-0855-4153-afef-b7883afeca8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:33.928976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da4bc40a-0855-4153-afef-b7883afeca8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:33.929431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da4bc40a-0855-4153-afef-b7883afeca8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.005764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-da4bc40a-0855-4153-afef-b7883afeca8f tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087897 May 09 18:32:34.006363 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 184/372] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:32:33 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:34.393861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:34.394515 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:34.403330 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.403859 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.404727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.405260 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.436848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.437522 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.437743 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lazy-loading 'fault' on Instance uuid d589e885-2446-4a24-8bf1-6fc302a5746d {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:32:34.460380 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:34.461009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:34.468706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.469173 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.469957 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.470408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.537772 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfc640ee055498e9af6151c5d3320d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366da93a37f54180a7c2226d90a2356d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:34.545575 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-632e4596-6117-49da-8752-4432dcd72b6a tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 200 len: 1303 microversion: 2.1 time: 0.155478 May 09 18:32:34.546157 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 189/373] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:34 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:34.711542 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:34.720113 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:34.721705 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:34.722941 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e0a106a4-5db4-49e1-ad3e-dc3bb1d40be8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.266416 May 09 18:32:34.723559 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 185/374] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:34 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:32:34.756920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:34.757548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:34.763875 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.764341 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.765123 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.765575 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.940918 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:34.949288 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-44203911-638f-4ac8-9d2d-c9b55ae1d1d9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1701 microversion: 2.1 time: 0.196194 May 09 18:32:34.950062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 190/375] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:34 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1701 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:34.966825 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-384f91a6-695e-4842-83e1-f4e3fe92e5ac tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:34.973274 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-384f91a6-695e-4842-83e1-f4e3fe92e5ac tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:34.973836 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-384f91a6-695e-4842-83e1-f4e3fe92e5ac tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:34.996501 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-384f91a6-695e-4842-83e1-f4e3fe92e5ac tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Going to try to start instance {{(pid=117088) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 18:32:35.040128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-384f91a6-695e-4842-83e1-f4e3fe92e5ac tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action" status: 202 len: 0 microversion: 2.1 time: 0.077952 May 09 18:32:35.040739 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 186/376] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:32:34 2022] POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:32:35.049226 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:35.049861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:35.055862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:35.056322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.057289 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:35.057910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.224492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-99358db2-4430-4dcc-937f-f1e1d499c80d req-7636964c-e179-44f5-b85f-4bc7b2f331e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a3f8d9-8713-420a-8b24-b30d90e869b6", "tag": "3976c86a-41ed-4aae-b61d-e0d4b31b0fa3"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:35.234104 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-99358db2-4430-4dcc-937f-f1e1d499c80d req-7636964c-e179-44f5-b85f-4bc7b2f331e9 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:35.234564 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-99358db2-4430-4dcc-937f-f1e1d499c80d req-7636964c-e179-44f5-b85f-4bc7b2f331e9 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.248207 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-99358db2-4430-4dcc-937f-f1e1d499c80d req-7636964c-e179-44f5-b85f-4bc7b2f331e9 service nova] Creating event network-changed:3976c86a-41ed-4aae-b61d-e0d4b31b0fa3 for instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 on hv-cinder-84112 May 09 18:32:35.253910 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-99358db2-4430-4dcc-937f-f1e1d499c80d req-7636964c-e179-44f5-b85f-4bc7b2f331e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033482 May 09 18:32:35.254708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 187/377] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:32:35.279785 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:35.288934 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b75a61d6-5484-4f45-8cf7-1813673346cd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1710 microversion: 2.1 time: 0.243502 May 09 18:32:35.289512 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 191/378] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:35 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1710 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:32:35.563167 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:35.564047 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] [instance: d589e885-2446-4a24-8bf1-6fc302a5746d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:35.570449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:35.570953 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.571736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:35.572219 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.586621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] HTTP exception thrown: Instance d589e885-2446-4a24-8bf1-6fc302a5746d could not be found. May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Request method failure captured: May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d HTTP/1.1 May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV4l5XhUtTLdW0_wKbyNapFYR_c9OrRyNsB_nXxKzpXr7AFm1yqIcxVU0EJQjlVKuNtik7nrsq_p1No9vCqlO7QxPCtzi7zGuzVymUx1O0qcuNBTlKYoQ4lblJq7bvkfA77uVJYR6KHN5Mnp03yoKJ66lcXi8cm_ltkEq_NefOvpEJE May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 366da93a37f54180a7c2226d90a2356d May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesNegativeTest-135227838 May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:32:35.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/366da93a37f54180a7c2226d90a2356d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/366da93a37f54180a7c2226d90a2356d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/366da93a37f54180a7c2226d90a2356d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_366da93a37f54180a7c2226d90a2356d"}]}] May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesNegativeTest-135227838 May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 366da93a37f54180a7c2226d90a2356d May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesNegativeTest-135227838 May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesNegativeTest-135227838-project May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 4dfc640ee055498e9af6151c5d3320d8 May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesNegativeTest-135227838-project May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance d589e885-2446-4a24-8bf1-6fc302a5746d could not be found. May 09 18:32:35.589766 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'd589e885-2446-4a24-8bf1-6fc302a5746d'} May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d589e885-2446-4a24-8bf1-6fc302a5746d could not be found. May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:32:35.590513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d589e885-2446-4a24-8bf1-6fc302a5746d could not be found. May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d589e885-2446-4a24-8bf1-6fc302a5746d could not be found. May 09 18:32:35.591720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:32:35.592793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] Returning 404 to user: Instance d589e885-2446-4a24-8bf1-6fc302a5746d could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:32:35.592793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-74ed9b13-1802-4b18-97bc-6e083f3d5250 tempest-VolumesNegativeTest-135227838 tempest-VolumesNegativeTest-135227838-project] 10.222.0.25 "GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d" status: 404 len: 111 microversion: 2.1 time: 0.030787 May 09 18:32:35.593975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 188/379] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:35 2022] GET /compute/v2.1/servers/d589e885-2446-4a24-8bf1-6fc302a5746d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:32:35.742002 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:35.743046 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:35.753587 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:35.754233 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.755203 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:35.755917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:35.964031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:35.982617 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:35.984185 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:35.985576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d9a2375b-bc02-4613-839d-0bfd5ae7d4d5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.247776 May 09 18:32:35.986133 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 192/380] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:35 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:36.305637 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:36.306296 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:36.313814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:36.314283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:36.315096 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:36.315556 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:36.473964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:36.482727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-003f4fd7-0b2a-41fe-ad11-3e9453a5a3a8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1710 microversion: 2.1 time: 0.180940 May 09 18:32:36.483376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 189/381] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:36 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1710 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:37.004368 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:37.005035 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:37.011724 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.012178 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.012948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.013389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.151404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:37.159108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:37.160682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:37.161848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-081d1bee-68ac-4c54-a15d-73243bb498a5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.161707 May 09 18:32:37.162592 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 193/382] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:36 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:37.501021 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:37.501681 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:37.508063 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.508538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.510501 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:37.510970 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:37.644609 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:37.652869 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-af957aa0-eafe-49a6-a926-daed954b059a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1714 microversion: 2.1 time: 0.156348 May 09 18:32:37.653477 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 190/383] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:32:37 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:32:38.180296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:38.180983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:38.187653 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:38.188117 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:38.188900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:38.189519 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:38.334521 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:38.343400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:38.345339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:38.346718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c4e50382-d933-4fa5-a691-ceb530ffad20 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.170617 May 09 18:32:38.347316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 194/384] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:38 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:39.378014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:39.378644 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:39.384997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:39.385462 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:39.386240 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:39.386687 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:39.512345 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:39.520267 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:39.521771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:39.522932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-03d8d46c-cdf1-4d22-8993-2645dee4a5dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.149109 May 09 18:32:39.523526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 191/385] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:39 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:40.542096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:40.542725 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:40.549395 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.549859 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.550634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:40.551088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:40.907975 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:40.916301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:40.917814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:40.918966 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-274d4752-12ba-4ca5-a3e7-c1e95af332ca tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.381316 May 09 18:32:40.919562 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 195/386] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:40 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:41.937720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:41.938367 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:41.944858 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:41.945317 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:41.946086 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:41.946530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:42.071141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:42.079415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:42.080932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:42.082093 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b68f83f3-6e05-4dde-8500-18aef183e4b6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.148356 May 09 18:32:42.082652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 192/387] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:41 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:43.100349 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:43.100974 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:43.107333 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:43.107794 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:43.108568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:43.109012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:43.237084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:43.244877 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:43.246390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:43.247574 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4966eb14-baa1-44e9-bb20-fe844049922c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.151120 May 09 18:32:43.248137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 196/388] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:43 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:44.266033 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:44.266654 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:44.273261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:44.273720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:44.274490 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:44.275455 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:44.409124 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:44.417714 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:44.419258 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:44.420430 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a04dc010-fe0c-4f18-ba41-1ac828447062 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1741 microversion: 2.20 time: 0.158272 May 09 18:32:44.421215 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 193/389] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:44 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:45.438422 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:45.439047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:45.445388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:45.445840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:45.446605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:45.447043 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:45.568501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:45.576072 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:45.577600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:45.578744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-943a6213-3e86-4af5-a083-fee6afdf9ec1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1741 microversion: 2.20 time: 0.144333 May 09 18:32:45.579331 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 197/390] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:45 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1741 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:46.566391 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-393f7f30-30d5-45d4-802c-eab30b19d9f2 req-c465713e-582c-4071-869f-2ee4700b2045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5c8d4-23e0-426a-806c-d472fcd826fb", "name": "network-vif-plugged", "status": "completed", "tag": "8c59628d-9fbb-446b-9fc4-96acde9b707f"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:32:46.576924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-393f7f30-30d5-45d4-802c-eab30b19d9f2 req-c465713e-582c-4071-869f-2ee4700b2045 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.577379 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-393f7f30-30d5-45d4-802c-eab30b19d9f2 req-c465713e-582c-4071-869f-2ee4700b2045 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:46.588812 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-393f7f30-30d5-45d4-802c-eab30b19d9f2 req-c465713e-582c-4071-869f-2ee4700b2045 service nova] Creating event network-vif-plugged:8c59628d-9fbb-446b-9fc4-96acde9b707f for instance 02b5c8d4-23e0-426a-806c-d472fcd826fb on hv-cinder-84112 May 09 18:32:46.596485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-393f7f30-30d5-45d4-802c-eab30b19d9f2 req-c465713e-582c-4071-869f-2ee4700b2045 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033711 May 09 18:32:46.597499 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 194/391] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:32:46.599700 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:46.600956 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:46.607961 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.608487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:46.610026 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:46.610531 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:46.746766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:46.755130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:46.756661 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:46.757865 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d881a13b-3cb1-4736-97e9-fc7133938904 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.164867 May 09 18:32:46.758435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 198/392] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:46 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:47.791668 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:47.793584 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:47.805359 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:47.806075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:47.807855 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:47.808418 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:47.952165 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:47.960268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:47.961776 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:47.963639 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e1e2176d-14d9-4eae-9ab6-d66b7db4e7b1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.188727 May 09 18:32:47.971689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 195/393] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:47 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:48.982731 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:48.984111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:48.990029 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:48.990482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:48.991432 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:48.992210 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:49.138207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:49.146625 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:49.148977 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:49.151148 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5fd61732-ea98-4362-b4c7-a6592490cc48 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.172864 May 09 18:32:49.152259 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 199/394] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:48 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:50.170646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:50.171281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:50.177929 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:50.178711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:50.179748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:50.180615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:50.325432 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:50.334293 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:50.335918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:50.337800 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9eb38520-83e2-48ba-b667-dad31509234f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.171104 May 09 18:32:50.338627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 196/395] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:50 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:51.356202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:51.356864 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:51.363720 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:51.364256 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:51.365176 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:51.365762 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:51.518557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:51.528236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:51.529876 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:51.531047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2398872d-ee79-4f66-9659-b498a34f7429 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.178896 May 09 18:32:51.531648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 200/396] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:51 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:52.549451 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:52.550195 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:52.557827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:52.558293 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:52.559130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:52.559608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:52.702544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:52.711001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:52.712836 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:52.714276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-830e9a01-cb9f-4963-a745-a9646ce0b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.168782 May 09 18:32:52.714869 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 197/397] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:52 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:53.735145 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:53.735766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:53.742314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:53.742774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:53.744094 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:53.744541 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:53.883147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:53.891765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:53.893268 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:53.896899 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1f2d8df9-48ca-4823-8d7a-57dfa3fe1c82 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.165932 May 09 18:32:53.897893 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 201/398] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:53 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:54.915775 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:54.916470 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:54.923372 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:54.923833 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:54.924626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:54.925224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:55.078373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:55.086520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:55.088133 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:55.089467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ed1b29eb-09ff-4613-a177-b0cc4ee910ec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.177672 May 09 18:32:55.090120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 198/399] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:54 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:56.107272 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:56.107890 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:56.114358 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:56.114871 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:56.115685 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:56.116125 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:56.247703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:56.256834 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:56.258601 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:56.259798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5bd5b531-86b6-451b-ba1e-2390b16bdaf2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1736 microversion: 2.20 time: 0.156380 May 09 18:32:56.260356 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 202/400] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:56 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:32:57.279917 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:57.280588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:57.287007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:57.287502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:57.288289 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:57.288744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:57.436634 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:57.444309 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:57.445817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:57.447613 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-065b002e-03fe-46cb-843d-91b5e0aa1edb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1718 microversion: 2.20 time: 0.171893 May 09 18:32:57.448171 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 199/401] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:57 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:58.466751 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:58.467440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:58.473729 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.474185 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.475095 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:58.475565 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:58.612683 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:58.620554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:58.622052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:58.623332 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c0e9ab45-a639-4178-b290-1152a4a531d0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1718 microversion: 2.20 time: 0.161029 May 09 18:32:58.623896 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 203/402] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:58 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:32:59.642322 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:32:59.643011 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:32:59.649569 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:59.650029 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:59.650802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:32:59.651273 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:32:59.785088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:59.792966 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:59.794485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:32:59.795669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6abc5926-c87d-46c0-870f-8cffde2d5b46 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1718 microversion: 2.20 time: 0.157500 May 09 18:32:59.801373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 200/403] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:32:59 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:00.582100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-4c4e8968-c5e2-4535-ac71-995ae6428cc0 req-fba6d9d3-a9bb-4902-bb58-d6edfc7f274e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5c8d4-23e0-426a-806c-d472fcd826fb", "name": "network-vif-unplugged", "status": "completed", "tag": "8c59628d-9fbb-446b-9fc4-96acde9b707f"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:00.591480 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-4c4e8968-c5e2-4535-ac71-995ae6428cc0 req-fba6d9d3-a9bb-4902-bb58-d6edfc7f274e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.591955 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-4c4e8968-c5e2-4535-ac71-995ae6428cc0 req-fba6d9d3-a9bb-4902-bb58-d6edfc7f274e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.608409 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.compute.server_external_events [req-4c4e8968-c5e2-4535-ac71-995ae6428cc0 req-fba6d9d3-a9bb-4902-bb58-d6edfc7f274e service nova] Unable to find a host for instance 02b5c8d4-23e0-426a-806c-d472fcd826fb. Dropping event network-vif-unplugged {{(pid=117087) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 18:33:00.609664 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-4c4e8968-c5e2-4535-ac71-995ae6428cc0 req-fba6d9d3-a9bb-4902-bb58-d6edfc7f274e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031291 May 09 18:33:00.610570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 204/404] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 09 18:33:00.709852 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-476ab70c-4797-4857-b5a9-51dad66c2f6d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:00.710425 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-476ab70c-4797-4857-b5a9-51dad66c2f6d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:00.717392 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476ab70c-4797-4857-b5a9-51dad66c2f6d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.717805 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476ab70c-4797-4857-b5a9-51dad66c2f6d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.718592 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476ab70c-4797-4857-b5a9-51dad66c2f6d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.719044 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476ab70c-4797-4857-b5a9-51dad66c2f6d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.741471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-476ab70c-4797-4857-b5a9-51dad66c2f6d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634/ips" status: 200 len: 150 microversion: 2.1 time: 0.035704 May 09 18:33:00.742044 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 201/405] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:33:00 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:00.752696 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c48dfa73-bec5-44de-88f1-893161bf2d1e"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:00.753786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:00.760497 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.760950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.761718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.762155 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.814246 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:00.815035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:00.823315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.823780 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.824568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.825019 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.852296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Invalid volume: volume c48dfa73-bec5-44de-88f1-893161bf2d1e is already attached to instances: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: POST /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634/os-volume_attachments HTTP/1.1 May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 74 May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:33:00.855506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {"volumeAttachment": {"volumeId": "c48dfa73-bec5-44de-88f1-893161bf2d1e"}} May 09 18:33:00.857057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Invalid volume: volume c48dfa73-bec5-44de-88f1-893161bf2d1e is already attached to instances: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'server_id': '79b90383-7829-430d-ba18-361f2ef96634', 'body': {'volumeAttachment': {'volumeId': 'c48dfa73-bec5-44de-88f1-893161bf2d1e'}}} May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c48dfa73-bec5-44de-88f1-893161bf2d1e is already attached to instances: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:00.857844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c48dfa73-bec5-44de-88f1-893161bf2d1e is already attached to instances: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:00.859040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c48dfa73-bec5-44de-88f1-893161bf2d1e is already attached to instances: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 400 to user: Invalid volume: volume c48dfa73-bec5-44de-88f1-893161bf2d1e is already attached to instances: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9232dd7f-da3e-4ea9-ba58-43836cbdbc01 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108846 May 09 18:33:00.860325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 205/406] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:33:00 2022] POST /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 09 18:33:00.866295 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:00.866801 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:00.876129 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.876591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.877388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:00.877839 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:00.909383 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:33:00.971420 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:00.979781 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:00.981360 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:00.982534 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f5e9e387-48ef-435f-878c-3ec052c7c4dd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1661 microversion: 2.20 time: 0.172212 May 09 18:33:00.983094 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 202/407] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:00 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1661 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:01.000554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-51f7410a-f069-440c-8b60-844ec0186459 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b73ed524-7295-4487-bfc2-0a8bf0c82753"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:01.002049 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-51f7410a-f069-440c-8b60-844ec0186459 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:01.008891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f7410a-f069-440c-8b60-844ec0186459 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.009491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f7410a-f069-440c-8b60-844ec0186459 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.010359 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f7410a-f069-440c-8b60-844ec0186459 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.010820 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51f7410a-f069-440c-8b60-844ec0186459 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.015269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-34ff0894-59d3-47d8-b119-8ffbec6a8597 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 204 len: 0 microversion: 2.1 time: 0.152444 May 09 18:33:01.015853 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 206/408] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:33:00 2022] DELETE /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 18:33:01.025030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:01.025798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:01.031739 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.032214 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.033004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.033467 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.179963 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:01.188528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f901829b-18c8-4cd1-a92f-ae3d6ffe041a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1683 microversion: 2.1 time: 0.168183 May 09 18:33:01.189101 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 207/409] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:01 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:01.310993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-51f7410a-f069-440c-8b60-844ec0186459 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314688 May 09 18:33:01.311620 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 203/410] 10.222.0.25 () {62 vars in 1363 bytes} [Mon May 9 18:33:00 2022] POST /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:33:01.421308 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-df267080-0f3e-4285-be9c-f8760cbd1e1c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:01.421882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-df267080-0f3e-4285-be9c-f8760cbd1e1c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:01.427661 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df267080-0f3e-4285-be9c-f8760cbd1e1c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.428118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df267080-0f3e-4285-be9c-f8760cbd1e1c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.428883 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df267080-0f3e-4285-be9c-f8760cbd1e1c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.429324 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df267080-0f3e-4285-be9c-f8760cbd1e1c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.519288 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-df267080-0f3e-4285-be9c-f8760cbd1e1c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/action" status: 202 len: 0 microversion: 2.20 time: 0.101603 May 09 18:33:01.519809 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 208/411] 10.222.0.25 () {62 vars in 1318 bytes} [Mon May 9 18:33:01 2022] POST /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:33:01.528764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:01.529664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:01.537827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.538289 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.539078 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:01.540111 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:01.672736 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:01.681599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:01.683142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:01.684321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2e12c4a5-42db-48a1-85dd-9bf96c0f4ee8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1747 microversion: 2.20 time: 0.159858 May 09 18:33:01.684910 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 204/412] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:01 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:02.207795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:02.208522 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:02.214976 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:02.215463 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:02.216250 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:02.216696 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:02.345216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:02.352895 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-51a462d9-54d6-4ad2-8b67-97f543ea891f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1683 microversion: 2.1 time: 0.149499 May 09 18:33:02.353545 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 209/413] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:02 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:02.702853 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:02.703428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:02.709737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:02.710202 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:02.710981 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:02.711515 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:02.841912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:02.850195 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:02.851754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:02.852956 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c9428319-c6a9-4cc2-ba88-689741cc9243 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1749 microversion: 2.20 time: 0.154140 May 09 18:33:02.853555 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 205/414] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:02 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:03.370558 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:03.371119 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:03.378228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.378697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:03.379607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.380687 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:03.516774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:03.524381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-850d5c17-3620-4d9f-bb5d-418daceed142 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1683 microversion: 2.1 time: 0.158224 May 09 18:33:03.524968 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 210/415] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:03 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:03.871401 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:03.872036 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:03.878932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.879582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:03.880381 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:03.880830 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.042577 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:04.066525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:04.068201 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:04.069462 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bdd72727-6e95-478f-8727-c6441a9a988d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1749 microversion: 2.20 time: 0.202581 May 09 18:33:04.075551 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 206/416] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:03 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1749 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:04.112424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-fc507203-e35e-4166-aaee-95f5caf69daf req-4816da2d-3adf-457a-b4dc-7d406bc0851b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b90383-7829-430d-ba18-361f2ef96634", "name": "network-vif-deleted", "tag": "c3f65dac-7ea9-4b15-b33e-a6d90602c869"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:04.122118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-fc507203-e35e-4166-aaee-95f5caf69daf req-4816da2d-3adf-457a-b4dc-7d406bc0851b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.123120 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-fc507203-e35e-4166-aaee-95f5caf69daf req-4816da2d-3adf-457a-b4dc-7d406bc0851b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.144063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-fc507203-e35e-4166-aaee-95f5caf69daf req-4816da2d-3adf-457a-b4dc-7d406bc0851b service nova] Creating event network-vif-deleted:c3f65dac-7ea9-4b15-b33e-a6d90602c869 for instance 79b90383-7829-430d-ba18-361f2ef96634 on hv-cinder-84112 May 09 18:33:04.150827 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-fc507203-e35e-4166-aaee-95f5caf69daf req-4816da2d-3adf-457a-b4dc-7d406bc0851b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041996 May 09 18:33:04.152048 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 211/417] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:04.542263 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:04.542263 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:04.549329 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.549793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.550602 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.551046 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.587285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:04.588142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:04.589410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lazy-loading 'fault' on Instance uuid 79b90383-7829-430d-ba18-361f2ef96634 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:33:04.641799 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:04.649840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-59f2ce19-f3c1-497f-8f48-207ae89830db tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 200 len: 1332 microversion: 2.1 time: 0.111309 May 09 18:33:04.650415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 207/418] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:04 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:05.094162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:05.096132 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:05.104612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.105337 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.106291 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.106896 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.267280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:05.279034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:05.281040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:05.282869 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fd013d4e-10da-40b5-bfa4-c5b8f809d218 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.198496 May 09 18:33:05.283999 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 212/419] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:05 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:05.666922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:05.667718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:05.674190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.674738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.675628 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:05.676742 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:05.691855 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 HTTP/1.1 May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:33:05.693545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:33:05.695014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '79b90383-7829-430d-ba18-361f2ef96634'} May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:33:05.696450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:33:05.697818 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:33:05.699162 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:33:05.699162 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-626be4a1-875d-40c4-841a-92a6eaed032e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 404 len: 111 microversion: 2.1 time: 0.031952 May 09 18:33:05.699162 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 208/420] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:05 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:33:05.704363 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-73ce3746-edcf-4aa6-9df0-a554ed0ccddf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '.version_select at 0x7f3f7e91dca0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:05.723808 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-73ce3746-edcf-4aa6-9df0-a554ed0ccddf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682559405" status: 202 len: 0 microversion: 2.1 time: 0.022988 May 09 18:33:05.732322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 213/421] 10.222.0.25 () {58 vars in 1220 bytes} [Mon May 9 18:33:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682559405 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:33:06.314689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:06.315421 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:06.325027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.328520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.329678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.335661 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.566744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:06.592036 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:06.594545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:06.597158 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6944d247-7a4c-4681-9485-eae845cd9c9b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.299425 May 09 18:33:06.604583 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 209/422] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:06 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:06.657931 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:06.658498 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:06.667698 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.668442 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.669233 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.669809 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.822215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lazy-loading 'services' on Instance uuid 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:33:06.937067 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3604594a-7fb2-4af2-9821-c63f5c7c8145 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments/c48dfa73-bec5-44de-88f1-893161bf2d1e" status: 202 len: 0 microversion: 2.1 time: 0.284106 May 09 18:33:06.938008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 214/423] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:33:06 2022] DELETE /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments/c48dfa73-bec5-44de-88f1-893161bf2d1e => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:33:06.947268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-faa579a7-c014-473c-a5ec-13284ddcd2d2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:06.948388 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-faa579a7-c014-473c-a5ec-13284ddcd2d2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:06.955366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faa579a7-c014-473c-a5ec-13284ddcd2d2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.955823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faa579a7-c014-473c-a5ec-13284ddcd2d2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.956622 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faa579a7-c014-473c-a5ec-13284ddcd2d2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:06.957063 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faa579a7-c014-473c-a5ec-13284ddcd2d2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:06.992606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-faa579a7-c014-473c-a5ec-13284ddcd2d2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 May 09 18:33:06.993144 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 210/424] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:06 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:07.623084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:07.624019 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:07.630972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:07.631579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:07.632468 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:07.633027 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:07.768756 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:07.777466 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:07.779001 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:07.780253 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-af33706d-f404-4e8a-9bae-bf972bd8bd2c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.161451 May 09 18:33:07.780847 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 215/425] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:07 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:08.004974 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f55e1841-c166-48d9-a1f0-bd1ad282a1a0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:08.006667 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f55e1841-c166-48d9-a1f0-bd1ad282a1a0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:08.013467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f55e1841-c166-48d9-a1f0-bd1ad282a1a0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.014170 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f55e1841-c166-48d9-a1f0-bd1ad282a1a0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.014973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f55e1841-c166-48d9-a1f0-bd1ad282a1a0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.015654 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f55e1841-c166-48d9-a1f0-bd1ad282a1a0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.048562 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f55e1841-c166-48d9-a1f0-bd1ad282a1a0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047589 May 09 18:33:08.049313 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 211/426] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:07 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:08.799793 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:08.800525 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:08.807016 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.807518 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.808300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:08.808744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:08.949721 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:08.962770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:08.964308 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:08.965480 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c28c3d43-8b5a-46bd-badd-abcdb1da02e6 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.169607 May 09 18:33:08.966220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 216/427] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:08 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:09.060331 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc4a47a8-bc94-4119-95e7-5acfc2465b14 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:09.061933 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fc4a47a8-bc94-4119-95e7-5acfc2465b14 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:09.068586 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc4a47a8-bc94-4119-95e7-5acfc2465b14 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.068952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc4a47a8-bc94-4119-95e7-5acfc2465b14 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:09.069730 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc4a47a8-bc94-4119-95e7-5acfc2465b14 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.070184 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc4a47a8-bc94-4119-95e7-5acfc2465b14 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:09.104019 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fc4a47a8-bc94-4119-95e7-5acfc2465b14 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047500 May 09 18:33:09.104761 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 212/428] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:09 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:33:09.983471 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:09.984096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:09.990584 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.991316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:09.992109 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:09.992556 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:10.115325 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-084f202f-c907-4acc-a62d-fd6531f52f79 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:10.117058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-084f202f-c907-4acc-a62d-fd6531f52f79 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:10.125406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084f202f-c907-4acc-a62d-fd6531f52f79 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:10.125865 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084f202f-c907-4acc-a62d-fd6531f52f79 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:10.126856 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084f202f-c907-4acc-a62d-fd6531f52f79 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:10.127550 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084f202f-c907-4acc-a62d-fd6531f52f79 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:10.127682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:10.139109 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:10.140847 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:10.142036 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ce060f4c-6c54-4933-aed4-69435f41fa4f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.162531 May 09 18:33:10.142637 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 217/429] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:09 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:10.161326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-084f202f-c907-4acc-a62d-fd6531f52f79 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049977 May 09 18:33:10.165262 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 213/430] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:10 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:11.159821 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:11.160437 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:11.168089 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.168560 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.169532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.170187 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.174624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f18977c8-a883-4efd-af1c-3b1c743516aa tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:11.175596 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f18977c8-a883-4efd-af1c-3b1c743516aa tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:11.181953 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f18977c8-a883-4efd-af1c-3b1c743516aa tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.182415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f18977c8-a883-4efd-af1c-3b1c743516aa tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.183342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f18977c8-a883-4efd-af1c-3b1c743516aa tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:11.183791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f18977c8-a883-4efd-af1c-3b1c743516aa tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:11.215431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f18977c8-a883-4efd-af1c-3b1c743516aa tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045596 May 09 18:33:11.215937 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 214/431] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:11 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:33:11.309283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:11.318762 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:11.321103 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:11.322225 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bdb264a4-9d89-430b-b5c2-1d50e330760e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.166336 May 09 18:33:11.325585 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 218/432] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:11 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:12.228104 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-da73232c-d2c4-405e-a002-100dfe14b262 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:12.229321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-da73232c-d2c4-405e-a002-100dfe14b262 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:12.235843 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da73232c-d2c4-405e-a002-100dfe14b262 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:12.236307 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da73232c-d2c4-405e-a002-100dfe14b262 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:12.237098 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da73232c-d2c4-405e-a002-100dfe14b262 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:12.237544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da73232c-d2c4-405e-a002-100dfe14b262 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:12.268269 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-da73232c-d2c4-405e-a002-100dfe14b262 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 May 09 18:33:12.269034 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 215/433] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:12 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:12.342001 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:12.342615 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:12.348968 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:12.349430 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:12.350205 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:12.350650 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:12.486367 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:12.494676 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:12.496169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:12.497335 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-161df3ce-0a9e-439e-9c7d-63aba346cb30 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.159219 May 09 18:33:12.497893 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 219/434] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:12 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:13.280607 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-af13c220-1d18-4e52-b922-fb0a9c39bd70 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:13.281555 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-af13c220-1d18-4e52-b922-fb0a9c39bd70 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:13.287921 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af13c220-1d18-4e52-b922-fb0a9c39bd70 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:13.288516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af13c220-1d18-4e52-b922-fb0a9c39bd70 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:13.290049 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af13c220-1d18-4e52-b922-fb0a9c39bd70 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:13.290503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-af13c220-1d18-4e52-b922-fb0a9c39bd70 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:13.321148 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-af13c220-1d18-4e52-b922-fb0a9c39bd70 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 May 09 18:33:13.321729 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 216/435] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:13 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:13.516457 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:13.517193 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:13.524314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:13.524781 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:13.525580 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:13.526033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:13.669369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:13.678579 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:13.680216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:13.681400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-db422eef-f5ab-4651-a9a8-cc5817af9333 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.168831 May 09 18:33:13.681970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 220/436] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:13 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:33:14.333324 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7e3f3a93-822e-4f4f-95f8-0f07be178250 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:14.334256 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7e3f3a93-822e-4f4f-95f8-0f07be178250 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:14.340623 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e3f3a93-822e-4f4f-95f8-0f07be178250 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.341089 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e3f3a93-822e-4f4f-95f8-0f07be178250 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.341874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e3f3a93-822e-4f4f-95f8-0f07be178250 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.342318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e3f3a93-822e-4f4f-95f8-0f07be178250 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.373120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7e3f3a93-822e-4f4f-95f8-0f07be178250 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 May 09 18:33:14.373705 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 217/437] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:14 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:14.701457 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:14.702858 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:14.711452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.711865 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.712606 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:14.713061 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:14.847496 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:14.856745 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:14.858302 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:14.859506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6c10a992-a3ba-45ba-aef8-aedee2af0c7f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.163625 May 09 18:33:14.860076 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 221/438] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:14 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:15.385529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e72dc455-c972-4773-a7f2-c2f33ee145b8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:15.386469 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e72dc455-c972-4773-a7f2-c2f33ee145b8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:15.392680 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e72dc455-c972-4773-a7f2-c2f33ee145b8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:15.393137 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e72dc455-c972-4773-a7f2-c2f33ee145b8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:15.393933 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e72dc455-c972-4773-a7f2-c2f33ee145b8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:15.394576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e72dc455-c972-4773-a7f2-c2f33ee145b8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:15.422032 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e72dc455-c972-4773-a7f2-c2f33ee145b8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041180 May 09 18:33:15.422569 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 218/439] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:15 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:15.878083 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:15.878624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:15.885008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:15.885464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:15.886228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:15.886671 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:16.015083 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:16.023844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:16.025361 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:16.026514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-68150aff-b488-4546-93e8-8523401b7c5c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.152630 May 09 18:33:16.027076 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 222/440] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:15 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:16.434120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3b1671d6-790d-4248-b8ad-9bd6c90d1795 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:16.434994 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3b1671d6-790d-4248-b8ad-9bd6c90d1795 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:16.441178 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b1671d6-790d-4248-b8ad-9bd6c90d1795 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:16.441630 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b1671d6-790d-4248-b8ad-9bd6c90d1795 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:16.442395 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b1671d6-790d-4248-b8ad-9bd6c90d1795 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:16.442834 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b1671d6-790d-4248-b8ad-9bd6c90d1795 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:16.473454 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3b1671d6-790d-4248-b8ad-9bd6c90d1795 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 May 09 18:33:16.474015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 219/441] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:16 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:17.045084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:17.045709 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:17.052025 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.052484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.053261 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.053706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.181089 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:17.189201 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:17.190706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:17.191882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3bb4b329-3d26-43eb-b33c-5efe23b0d7a1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.150652 May 09 18:33:17.192431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 223/442] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:17 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:17.485684 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e9522aa2-7fc6-4221-aebf-d73348252a3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:17.486625 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e9522aa2-7fc6-4221-aebf-d73348252a3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:17.492930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9522aa2-7fc6-4221-aebf-d73348252a3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.493394 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9522aa2-7fc6-4221-aebf-d73348252a3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.494166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9522aa2-7fc6-4221-aebf-d73348252a3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.494611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9522aa2-7fc6-4221-aebf-d73348252a3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.523166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e9522aa2-7fc6-4221-aebf-d73348252a3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041316 May 09 18:33:17.524264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 220/443] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:33:17 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:33:17.582073 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:17.582627 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:17.588557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.589011 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.589786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.590228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.614322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:33:17.689510 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cc95aa41-bb6a-4668-a445-cbf76a2b3bbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 204 len: 0 microversion: 2.1 time: 0.110920 May 09 18:33:17.690103 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 224/444] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:33:17 2022] DELETE /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 18:33:17.698775 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:17.699430 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:17.705153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.705607 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.706372 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:17.706815 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:17.832343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:17.839903 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4f32b33f-6c6b-45fa-a459-e83aef8cf309 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1680 microversion: 2.1 time: 0.145507 May 09 18:33:17.840467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 221/445] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:17 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:18.210730 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:18.211384 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:18.217270 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:18.217729 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:18.218501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:18.218943 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:18.343858 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:18.352483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:18.353994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:18.355232 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1f870c7b-99c6-4cc3-a239-b02eadc6cca7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.149017 May 09 18:33:18.355975 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 225/446] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:18 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:18.859813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:18.860437 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:18.866621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:18.867058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:18.867859 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:18.868312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:18.995917 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:19.003382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4c3118ac-b98f-4976-a695-17c33de01d85 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1680 microversion: 2.1 time: 0.147375 May 09 18:33:19.003948 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 222/447] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:18 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:19.373764 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:19.374381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:19.380887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:19.381344 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:19.382117 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:19.383196 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:19.507067 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:19.515543 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:19.517086 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:19.518244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-09a30c42-7023-4a67-a6fc-543748fc51cd tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.148387 May 09 18:33:19.518809 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 226/448] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:19 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:20.021184 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:20.021812 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:20.028966 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.029431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.030244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.030693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.162031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:20.170605 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-426067d9-abe0-4af4-801f-306e739dbc7b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 200 len: 1680 microversion: 2.1 time: 0.153216 May 09 18:33:20.177985 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 223/449] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:20 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:20.455591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-22a168c2-ab1a-4dfb-82e7-0cebbfd969c5 req-45471150-9313-4d53-8c13-bd957e401654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f", "name": "network-vif-deleted", "tag": "97fbd8b0-83c4-4955-a743-dfced983ab62"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:20.464307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-22a168c2-ab1a-4dfb-82e7-0cebbfd969c5 req-45471150-9313-4d53-8c13-bd957e401654 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.464762 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-22a168c2-ab1a-4dfb-82e7-0cebbfd969c5 req-45471150-9313-4d53-8c13-bd957e401654 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.475332 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-22a168c2-ab1a-4dfb-82e7-0cebbfd969c5 req-45471150-9313-4d53-8c13-bd957e401654 service nova] Creating event network-vif-deleted:97fbd8b0-83c4-4955-a743-dfced983ab62 for instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f on hv-cinder-84112 May 09 18:33:20.480013 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-22a168c2-ab1a-4dfb-82e7-0cebbfd969c5 req-45471150-9313-4d53-8c13-bd957e401654 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028243 May 09 18:33:20.480928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 227/450] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:20.537209 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:20.538090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:20.544586 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.545518 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.546261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:20.546714 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:20.717468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:20.726427 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:20.728048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:20.729277 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e073ff04-ec5f-4f6f-8a20-15041992d3df tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.196622 May 09 18:33:20.729928 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 224/451] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:20 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:21.188745 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:21.189538 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:21.195642 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.196096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:21.196866 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.197310 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:21.210676 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f HTTP/1.1 May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:33:21.212402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:33:21.213786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f'} May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:33:21.214557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:33:21.215861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:21.217055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:33:21.217055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f55cf4b8-5779-4d86-ab72-3bbf478c9cbc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 404 len: 111 microversion: 2.1 time: 0.029303 May 09 18:33:21.217055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 228/452] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:21 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:33:21.225813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c7cc1b59-87b0-4da5-8125-c117244db6ca tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '.version_select at 0x7f3f7e855dc0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:21.246797 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c7cc1b59-87b0-4da5-8125-c117244db6ca tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719882760" status: 202 len: 0 microversion: 2.1 time: 0.024707 May 09 18:33:21.247424 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 225/453] 10.222.0.25 () {58 vars in 1220 bytes} [Mon May 9 18:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719882760 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:33:21.748127 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:21.748759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:21.755350 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.755814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:21.756661 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:21.757065 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:21.931932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e79e1a15-8b7e-41c5-b095-bb48b43096b6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: .version_select at 0x7f3f7e7c9e50>, body: {"keypair": {"name": "tempest-keypair-959670274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSyfZfK9lDYV6hk3/MyT+7c3uQMp/BOtjMKCGTtHLn62rs4b+X2+3KCr5YLvVM8n9WcPvPsjhBV9KbzfQYXWW/JKjgmgbvYm8Zla1TaDJ1itto69Copi47NOcp68kNiPA=="}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:21.948451 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:21.950922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-e79e1a15-8b7e-41c5-b095-bb48b43096b6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:21.956056 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-e79e1a15-8b7e-41c5-b095-bb48b43096b6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:21.957096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:21.958625 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:21.960550 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2787619a-7927-4ad9-afdc-77d6383c842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.216342 May 09 18:33:21.961529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 229/454] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:21 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:33:21.985006 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e79e1a15-8b7e-41c5-b095-bb48b43096b6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057555 May 09 18:33:21.985602 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 226/455] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:33:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:33:22.301234 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-18679eac-c9a8-45cb-a5bd-f950712abd5a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c490f8a-6329-4f12-8ed3-9c8b6d14eed3"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:22.302425 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-18679eac-c9a8-45cb-a5bd-f950712abd5a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:22.308765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18679eac-c9a8-45cb-a5bd-f950712abd5a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:22.309235 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18679eac-c9a8-45cb-a5bd-f950712abd5a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:22.310046 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18679eac-c9a8-45cb-a5bd-f950712abd5a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:22.310479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18679eac-c9a8-45cb-a5bd-f950712abd5a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:22.581849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-18679eac-c9a8-45cb-a5bd-f950712abd5a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284340 May 09 18:33:22.588053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 230/456] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:33:22 2022] POST /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:22.978488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:22.979244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:22.985610 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:22.986081 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:22.986894 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:22.987376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.183085 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:23.191231 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:23.192737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:23.193903 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6ba574d3-bf7b-4650-88d1-0010374b395c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.220032 May 09 18:33:23.194468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 227/457] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:22 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:23.355797 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-699626552", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "301e94ce-a989-4fe3-9992-0fa06fbc5e5e"}], "security_groups": [{"name": "tempest-securitygroup--1655524803"}], "key_name": "tempest-keypair-959670274", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:23.464713 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] validate_networks() for [('301e94ce-a989-4fe3-9992-0fa06fbc5e5e', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:33:23.817477 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:33:23.817916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:33:23.818399 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:33:23.818820 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:33:23.819279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:33:23.828414 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:23.828870 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.829683 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:23.830129 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:23.846353 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:33:23.850267 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:33:23.860900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:33:23.863236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:33:23.910789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-156d5137-6c1a-4e95-b477-99b84a881e2e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560398 May 09 18:33:23.911394 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 231/458] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:33:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 18:33:23.921361 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-de5b2585-6c7a-4c1d-afd8-0c611c38b3a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:23.921991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-de5b2585-6c7a-4c1d-afd8-0c611c38b3a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:23.974079 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-de5b2585-6c7a-4c1d-afd8-0c611c38b3a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:23.981124 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-de5b2585-6c7a-4c1d-afd8-0c611c38b3a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1240 microversion: 2.1 time: 0.063584 May 09 18:33:23.982007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 228/459] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:23 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:24.213012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:24.213853 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:24.221568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.222182 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.223012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.223500 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.361770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:24.370023 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:24.371647 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:24.372820 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4d099c00-1b3a-4c2f-b9c3-4f90a384875b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.164119 May 09 18:33:24.373378 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 232/460] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:24 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:24.722048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-8382a1f7-af89-4de7-8989-32e0dee8fd09 req-c7de6f01-73d0-4d2e-8e4e-799f2c93210c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5c8d4-23e0-426a-806c-d472fcd826fb", "name": "network-vif-plugged", "status": "completed", "tag": "8c59628d-9fbb-446b-9fc4-96acde9b707f"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:24.732239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8382a1f7-af89-4de7-8989-32e0dee8fd09 req-c7de6f01-73d0-4d2e-8e4e-799f2c93210c service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:24.733205 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8382a1f7-af89-4de7-8989-32e0dee8fd09 req-c7de6f01-73d0-4d2e-8e4e-799f2c93210c service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:24.744716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-8382a1f7-af89-4de7-8989-32e0dee8fd09 req-c7de6f01-73d0-4d2e-8e4e-799f2c93210c service nova] Creating event network-vif-plugged:8c59628d-9fbb-446b-9fc4-96acde9b707f for instance 02b5c8d4-23e0-426a-806c-d472fcd826fb on hv-cinder-84112 May 09 18:33:24.750026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-8382a1f7-af89-4de7-8989-32e0dee8fd09 req-c7de6f01-73d0-4d2e-8e4e-799f2c93210c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032126 May 09 18:33:24.750639 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 229/461] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:24.997804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:24.998431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:25.004612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.005071 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.005840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.006288 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.066578 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:25.074312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-47119500-7661-424a-91a4-186a3b59bbbf tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1300 microversion: 2.1 time: 0.080316 May 09 18:33:25.074883 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 233/462] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:24 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:25.391360 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:25.391890 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:25.398537 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.399264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.400335 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:25.400965 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:25.535906 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:25.545088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:25.546607 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:25.547809 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-915862e1-bcab-43e6-a850-685cfd20a1e0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.161149 May 09 18:33:25.548374 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 230/463] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:25 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:26.091583 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:26.092323 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:26.098667 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:26.099134 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:26.099944 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:26.100389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:26.161577 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:26.169813 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-affc600e-b803-400a-a47b-d24da5c8d209 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1298 microversion: 2.1 time: 0.081981 May 09 18:33:26.170400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 234/464] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:26 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:26.464384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:26.464918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:26.471215 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:26.471681 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:26.472452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:26.472929 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:26.565771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:26.566391 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:26.572860 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:26.573320 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:26.574088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:26.574698 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:26.602911 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lazy-loading 'services' on Instance uuid a7a805d4-1420-4adb-a173-724abc1e9915 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:33:26.710394 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:26.719047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:26.720024 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2dd25afd-3522-4087-9adb-e82ae0f4a17b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-volume_attachments/2345eb9f-0f1e-4639-8435-d0259209b849" status: 202 len: 0 microversion: 2.1 time: 0.259723 May 09 18:33:26.720806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:26.722396 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-289f7a5f-245c-4585-ae3b-dbdf86da94ed tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1805 microversion: 2.20 time: 0.160485 May 09 18:33:26.733779 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 235/465] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:26 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:33:26.735159 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 231/466] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:33:26 2022] DELETE /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-volume_attachments/2345eb9f-0f1e-4639-8435-d0259209b849 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:33:27.058605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-21fdde49-1c4f-4280-90c0-6d756b65186d req-6aa469a1-43fb-4222-8d4c-e57a034b0f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8b23f6-bf09-4784-bed1-4e2a9c013f91", "tag": "3cc28631-1ce9-4cb9-a981-f1bca63f379d"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:27.072347 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-21fdde49-1c4f-4280-90c0-6d756b65186d req-6aa469a1-43fb-4222-8d4c-e57a034b0f5d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.072828 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-21fdde49-1c4f-4280-90c0-6d756b65186d req-6aa469a1-43fb-4222-8d4c-e57a034b0f5d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.089856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-21fdde49-1c4f-4280-90c0-6d756b65186d req-6aa469a1-43fb-4222-8d4c-e57a034b0f5d service nova] Creating event network-changed:3cc28631-1ce9-4cb9-a981-f1bca63f379d for instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 on hv-cinder-84112 May 09 18:33:27.094936 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-21fdde49-1c4f-4280-90c0-6d756b65186d req-6aa469a1-43fb-4222-8d4c-e57a034b0f5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042215 May 09 18:33:27.096037 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 236/467] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:27.192922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:27.193709 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:27.202747 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.203239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.204027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.204652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.349426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:27.357824 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1cbe68c3-f999-4782-9197-22b4575e3bef tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1366 microversion: 2.1 time: 0.170635 May 09 18:33:27.358923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 232/468] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:27 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:27.741843 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:27.742554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:27.748511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.748975 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.750003 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:27.750622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:27.882851 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:27.892684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:27.894950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:27.896240 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-541ceb8d-10a8-4248-a711-834dbb9317a2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1792 microversion: 2.20 time: 0.159208 May 09 18:33:27.897109 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 237/469] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:33:27 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1792 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:33:28.375644 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:28.376267 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:28.383158 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.383640 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.384433 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:28.385074 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:28.512560 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:28.519744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3b980427-0a75-4f73-9239-8df529d0487c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1366 microversion: 2.1 time: 0.148254 May 09 18:33:28.520312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 233/470] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:28 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:29.536424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:29.537049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:29.543417 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.543879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.544659 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:29.545108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:29.668703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:29.675870 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4d2448f0-2530-4c20-85d3-0936b45345b1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1366 microversion: 2.1 time: 0.143308 May 09 18:33:29.676437 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 238/471] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:29 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:30.692877 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:30.694219 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:30.700556 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.701022 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:30.701817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:30.702268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:30.831576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:30.839133 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bf9c8ef0-e182-401d-997c-4927331dd737 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1366 microversion: 2.1 time: 0.150053 May 09 18:33:30.839735 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 234/472] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:30 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:31.002555 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a9fad039-1916-47ae-a8ce-701a42fd1072 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:31.008906 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a9fad039-1916-47ae-a8ce-701a42fd1072 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.009362 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a9fad039-1916-47ae-a8ce-701a42fd1072 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.067715 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a9fad039-1916-47ae-a8ce-701a42fd1072 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Going to try to stop instance {{(pid=117087) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 18:33:31.110150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a9fad039-1916-47ae-a8ce-701a42fd1072 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action" status: 202 len: 0 microversion: 2.1 time: 0.111447 May 09 18:33:31.111038 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 239/473] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:33:30 2022] POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:33:31.119744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:31.120685 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:31.128093 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.128742 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.129671 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.130175 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.164509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:31.165562 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:31.172117 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.172589 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.173389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.173843 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.198490 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lazy-loading 'flavor' on Instance uuid 73a3f8d9-8713-420a-8b24-b30d90e869b6 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:33:31.287277 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:31.294664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2b0a8f73-7dbf-46e4-9095-8ba754859d26 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.179666 May 09 18:33:31.295268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 235/474] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:31 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:31.328500 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2ab2382d-35e4-4fc9-ac7d-4d99bbac2984 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/action" status: 200 len: 32 microversion: 2.1 time: 0.168867 May 09 18:33:31.329114 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 240/475] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:33:31 2022] POST /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 09 18:33:31.338466 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:31.339153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:31.344936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.345398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.346188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.346617 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.475166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:31.483083 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-05fe33f6-ef1a-4b20-8f90-fef334c5927b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.148913 May 09 18:33:31.483760 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 236/476] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:31 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:31.856595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:31.857314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:31.863386 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.863851 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:31.864635 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:31.865086 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.012401 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:32.019631 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a568b353-318d-4dc5-b489-1e21626edcba tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1366 microversion: 2.1 time: 0.167198 May 09 18:33:32.020204 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 241/477] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:31 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:32.311932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:32.312586 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:32.318799 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.319274 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.320040 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.320483 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.443281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:32.450408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-89a6b632-bbf2-4792-811b-db04357048b8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.142330 May 09 18:33:32.450980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 237/478] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:32 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:32.500394 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:32.501019 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:32.506857 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.507364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.508144 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.508597 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.646487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:32.654858 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-78e1b621-2049-479c-8123-0892731cb2b8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.158554 May 09 18:33:32.655465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 242/479] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:32 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:32.762350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-9673aaa7-e1c1-461b-b1e2-4c5a37ab3a82 req-bf6980b4-dd00-45ad-89fa-64b6ac184ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8b23f6-bf09-4784-bed1-4e2a9c013f91", "name": "network-vif-plugged", "status": "completed", "tag": "3cc28631-1ce9-4cb9-a981-f1bca63f379d"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:32.770592 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-9673aaa7-e1c1-461b-b1e2-4c5a37ab3a82 req-bf6980b4-dd00-45ad-89fa-64b6ac184ade service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:32.771047 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-9673aaa7-e1c1-461b-b1e2-4c5a37ab3a82 req-bf6980b4-dd00-45ad-89fa-64b6ac184ade service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:32.782602 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-9673aaa7-e1c1-461b-b1e2-4c5a37ab3a82 req-bf6980b4-dd00-45ad-89fa-64b6ac184ade service nova] Creating event network-vif-plugged:3cc28631-1ce9-4cb9-a981-f1bca63f379d for instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 on hv-cinder-84112 May 09 18:33:32.787521 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-9673aaa7-e1c1-461b-b1e2-4c5a37ab3a82 req-bf6980b4-dd00-45ad-89fa-64b6ac184ade service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028876 May 09 18:33:32.788280 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 238/480] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:33.036839 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:33.037473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:33.044168 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.044624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.045401 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.045841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.169949 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:33.177280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9e8cda22-e6b8-4253-897c-8c3d324b6955 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1366 microversion: 2.1 time: 0.144688 May 09 18:33:33.177848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 243/481] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:33 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:33.468159 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:33.468902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:33.474997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.475529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.476315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.476769 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.601402 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:33.608717 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a9b200a7-db97-47fc-a82c-71ac8db627be tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.145268 May 09 18:33:33.609292 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 239/482] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:33 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:33.672519 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:33.673149 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:33.679098 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.679592 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.680368 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:33.680815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:33.805679 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:33.813399 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b4a45034-6721-4a70-a5d3-15564fbaba01 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.144670 May 09 18:33:33.813969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 244/483] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:33 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:34.194071 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:34.195271 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:34.201320 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.201821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.202559 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.203007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.331635 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:34.338891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-697d048e-adf3-4cc5-9b84-2af7af4494c8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1366 microversion: 2.1 time: 0.148694 May 09 18:33:34.339511 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 240/484] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:34 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:34.625318 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:34.625945 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:34.632283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.632751 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.633534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.633986 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.763118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:34.772942 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9c1b9f5a-88e1-4758-9ed6-5afea5d7dd42 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.151153 May 09 18:33:34.773524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 245/485] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:34 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:34.830196 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:34.830839 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:34.837715 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.838204 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.838980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:34.839454 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:34.968312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:34.976963 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6bcec300-e327-44bb-b48a-353c3bf774ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.150594 May 09 18:33:34.977529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 241/486] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:34 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:35.355681 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:35.356300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:35.362100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.362553 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.363347 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.363790 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.487372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:35.495026 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b8505fff-a253-495e-8286-3d2a41ff9a8a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1557 microversion: 2.1 time: 0.143202 May 09 18:33:35.495637 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 246/487] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:35 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1557 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:35.512013 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-92fa782f-f4e6-4c09-aa23-500db1a21c28 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:35.512526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-92fa782f-f4e6-4c09-aa23-500db1a21c28 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:35.518208 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92fa782f-f4e6-4c09-aa23-500db1a21c28 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.518672 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92fa782f-f4e6-4c09-aa23-500db1a21c28 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.519486 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92fa782f-f4e6-4c09-aa23-500db1a21c28 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.519940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92fa782f-f4e6-4c09-aa23-500db1a21c28 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.596357 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-92fa782f-f4e6-4c09-aa23-500db1a21c28 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088082 May 09 18:33:35.596977 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 242/488] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:33:35 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:35.790392 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:35.791119 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:35.797780 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.798235 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.799018 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:35.799493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:35.994891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:35.995554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:36.001797 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:36.002264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:36.003052 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:36.003528 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:36.156563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:36.164605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9a21ddb4-60da-45f1-aa1f-c9af803c6361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.378695 May 09 18:33:36.165299 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 247/489] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:35 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:36.303365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:36.311318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cd9268d5-c904-4f83-a42e-477f5f6cf935 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.321197 May 09 18:33:36.311895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 243/490] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:35 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:36.925954 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-aca5e985-ffd7-4cff-a854-91a702704849 req-87bf25f1-6102-4997-8ec2-68e381a1cacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8b23f6-bf09-4784-bed1-4e2a9c013f91", "tag": "3cc28631-1ce9-4cb9-a981-f1bca63f379d"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:36.935826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-aca5e985-ffd7-4cff-a854-91a702704849 req-87bf25f1-6102-4997-8ec2-68e381a1cacb service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:36.936286 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-aca5e985-ffd7-4cff-a854-91a702704849 req-87bf25f1-6102-4997-8ec2-68e381a1cacb service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:36.947405 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-aca5e985-ffd7-4cff-a854-91a702704849 req-87bf25f1-6102-4997-8ec2-68e381a1cacb service nova] Creating event network-changed:3cc28631-1ce9-4cb9-a981-f1bca63f379d for instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 on hv-cinder-84112 May 09 18:33:36.952149 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-aca5e985-ffd7-4cff-a854-91a702704849 req-87bf25f1-6102-4997-8ec2-68e381a1cacb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029850 May 09 18:33:36.952923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 248/491] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:37.182533 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:37.183281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:37.188973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.189438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.190227 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.190687 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.320210 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:37.328756 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5f63d5e7-d1a0-43f2-9302-9fbb6b23447d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.150827 May 09 18:33:37.330098 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:37.331092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:37.337965 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.338668 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.339050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 244/492] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:37 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:37.339817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:37.340389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:37.478895 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:37.486694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2775d4ff-c3ac-4c92-83d4-cb41ddaa4f16 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.161398 May 09 18:33:37.487287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 249/493] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:37 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:38.345846 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:38.346467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:38.352772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.353228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.353998 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.354439 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.478748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:38.485986 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3289f70b-02f1-4690-9384-97444b95bffb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.144009 May 09 18:33:38.486555 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 245/494] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:38 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:38.504013 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:38.504634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:38.511485 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.511944 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.512712 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:38.513152 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:38.636875 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:38.644910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6ac9ac92-c5f6-4bcc-888d-7cb83df82cb8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.144603 May 09 18:33:38.645473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 250/495] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:38 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:39.503735 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:39.504366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:39.511099 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.511595 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.512376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.512829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.641187 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:39.649055 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3e4cdeda-9d5d-4af5-be2d-6bcff05ac14e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.149164 May 09 18:33:39.649635 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 246/496] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:39 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:39.661660 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:39.662281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:39.668663 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.669122 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.669891 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:39.670335 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:39.795970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:39.803543 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-422bfd38-89fa-4222-a9b2-22d52021f89d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.145715 May 09 18:33:39.804106 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 251/497] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:39 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:40.666468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:40.667009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:40.673199 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:40.673660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:40.674424 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:40.674866 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:40.801724 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:40.808909 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6a89fc09-0ed1-465f-ab17-aa1f2cd19f55 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1678 microversion: 2.1 time: 0.146994 May 09 18:33:40.809472 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 247/498] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:40 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:40.820380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:40.820992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:40.827200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:40.827677 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:40.828442 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:40.828886 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:40.954728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:40.963042 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-94689ed4-f5ed-4dde-9ee9-fa035a9fe021 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.146412 May 09 18:33:40.963750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 252/499] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:40 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:41.825806 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:41.826547 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:41.833067 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.833536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.834319 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.834772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.962810 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:41.970243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a214607f-c9ab-4a4e-9ff4-86e178971afd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1655 microversion: 2.1 time: 0.148306 May 09 18:33:41.970820 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 248/500] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:41 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:41.979909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:41.980650 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:41.987323 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.987785 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.987922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-43c1765c-3994-4eac-92bc-257257cbc0d2 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:41.988568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.989012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:41.994528 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43c1765c-3994-4eac-92bc-257257cbc0d2 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:41.994997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43c1765c-3994-4eac-92bc-257257cbc0d2 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.016795 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-43c1765c-3994-4eac-92bc-257257cbc0d2 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Going to try to start instance {{(pid=117088) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 18:33:42.059883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-43c1765c-3994-4eac-92bc-257257cbc0d2 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action" status: 202 len: 0 microversion: 2.1 time: 0.076064 May 09 18:33:42.060515 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 249/501] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:33:41 2022] POST /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:33:42.068716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:42.069423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:42.075429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.076102 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.076882 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:42.077334 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:42.134108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:42.141994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-65c19ada-6e52-4f89-97ed-0e2a61e59156 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.165993 May 09 18:33:42.142892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 253/502] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:41 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:42.218880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:42.226844 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5d1b0aa5-3ba7-4130-b2a0-4d63a263a3df tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1664 microversion: 2.1 time: 0.162170 May 09 18:33:42.227464 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 250/503] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:42 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:43.159985 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:43.160519 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:43.166838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:43.167332 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:43.168115 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:43.168565 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:43.244431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:43.245053 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:43.251691 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:43.252154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:43.252977 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:43.253426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:43.306344 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:43.314092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8842e5c7-3973-4af3-be32-7a2b3f3f0223 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.158077 May 09 18:33:43.314669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 254/504] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:43 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:43.387015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:43.394287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f418a8c8-cde9-4b7c-82c5-5c9c42754081 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1664 microversion: 2.1 time: 0.154236 May 09 18:33:43.394848 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 251/505] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:43 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:44.330979 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:44.331634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:44.338508 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.338975 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.339780 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.340226 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.411516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:44.412138 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:44.418373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.418829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.419621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:44.420064 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:44.492394 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:44.500623 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fce6ee14-c978-473e-aef5-92473fb5cf0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.173460 May 09 18:33:44.501208 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 255/506] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:44 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:44.554816 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:44.562284 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1b4cc098-cfc2-4740-ab4a-77731dbe2c97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1668 microversion: 2.1 time: 0.154795 May 09 18:33:44.563118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 252/507] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:44 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:45.517885 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:45.518506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:45.524766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.525231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:45.526009 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:45.526452 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:45.651960 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:45.660475 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3ee2faba-135f-490b-847f-4791344b03a5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.146394 May 09 18:33:45.661062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 256/508] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:45 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:46.679197 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:46.680286 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:46.688460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:46.688923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:46.690538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:46.690538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:46.817982 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:46.826170 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fa0a175f-4b59-4cb9-a6f4-cd893473c22b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.151532 May 09 18:33:46.826737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 253/509] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:46 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:47.843252 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:47.843811 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:47.850100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.850551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:47.851358 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:47.851803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:47.977424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:47.985684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1c189296-3d48-452c-8404-adc129426f0c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.146405 May 09 18:33:47.986247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 257/510] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:47 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:49.003253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:49.003871 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:49.010163 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.010608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.011478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:49.011921 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:49.145485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:49.153978 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-df8848f4-ed1e-41c9-a8b7-36ad86b15a26 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.154866 May 09 18:33:49.154555 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 254/511] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:48 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:50.171499 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:50.172242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:50.178507 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.178966 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.180534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:50.180979 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:50.306624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:50.314893 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-866a0e35-cb91-4220-95ab-9e472514791c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1734 microversion: 2.1 time: 0.147199 May 09 18:33:50.315525 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 258/512] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:50 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:51.331661 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:51.332285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.339002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.339498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.340262 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.340702 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.463315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:51.471040 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9002e301-45f3-4830-a33a-eedf0c6c92de tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1714 microversion: 2.1 time: 0.143223 May 09 18:33:51.471644 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 255/513] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:51 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1714 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:51.570196 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:51.570701 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.576889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.577372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.578143 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.578584 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.656299 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] HTTP exception thrown: Cannot 'detach_volume' instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 while it is in vm_state rescued May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Request method failure captured: May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments/2c490f8a-6329-4f12-8ed3-9c8b6d14eed3 HTTP/1.1 May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2kHVKHC70jbdtlqcLtqCx7g8VL5Ug9a38m55Hd4sd7xI_aKp02cfltlH8kw6KHcPBWVNk_QCErJ0e4HWOjTcdH2NE1e3exEo9xfCwZYUBGt44Ky1nFiqcOLtH0XYYWol2eIWyOxRXndYcydWBN4_V5euBVPzJagYjI7UZEWWpXOsM May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:33:51.657917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_705eecf37fcc4fe7aabef923ece6ad59"}]}] May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: acae3ad19a7e45b9877520dff8f5b995 May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:33:51.659251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Cannot 'detach_volume' instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 while it is in vm_state rescued May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'server_id': '73a3f8d9-8713-420a-8b24-b30d90e869b6', 'id': '2c490f8a-6329-4f12-8ed3-9c8b6d14eed3'} May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:33:51.659919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 while it is in vm_state rescued May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 while it is in vm_state rescued May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:33:51.661287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Returning 409 to user: Cannot 'detach_volume' instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 while it is in vm_state rescued {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:33:51.662501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-729158af-7c25-4f42-94ff-6c4f8b72f8f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments/2c490f8a-6329-4f12-8ed3-9c8b6d14eed3" status: 409 len: 152 microversion: 2.1 time: 0.093623 May 09 18:33:51.662501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 259/514] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:33:51 2022] DELETE /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments/2c490f8a-6329-4f12-8ed3-9c8b6d14eed3 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 18:33:51.668238 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4ad84cd7-b04d-4fe5-8548-59d3c845a6e5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:51.668777 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ad84cd7-b04d-4fe5-8548-59d3c845a6e5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.674486 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ad84cd7-b04d-4fe5-8548-59d3c845a6e5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.674943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ad84cd7-b04d-4fe5-8548-59d3c845a6e5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.675742 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ad84cd7-b04d-4fe5-8548-59d3c845a6e5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.676188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ad84cd7-b04d-4fe5-8548-59d3c845a6e5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.740840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4ad84cd7-b04d-4fe5-8548-59d3c845a6e5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "POST /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/action" status: 202 len: 0 microversion: 2.1 time: 0.076199 May 09 18:33:51.741624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 256/515] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:33:51 2022] POST /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:33:51.750942 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:51.751615 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:51.758556 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.759020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.759903 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:51.760439 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:51.892111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:51.900316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-18533f90-5e29-48ff-a768-9dd70e1917f5 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1722 microversion: 2.1 time: 0.154524 May 09 18:33:51.900976 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 260/516] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:51 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:52.922969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:52.923727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:52.930048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.930509 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:52.931312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:52.931759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:53.064110 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:53.072553 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-828c0a56-1dfa-463c-83f0-95f41219c206 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1722 microversion: 2.1 time: 0.154354 May 09 18:33:53.073129 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 257/517] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:52 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:54.090254 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:54.090872 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:54.099459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.100493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.101279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:54.101729 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:54.229550 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:54.238054 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6e82a098-810a-4b59-b199-3aef5cc94a40 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1722 microversion: 2.1 time: 0.151669 May 09 18:33:54.238623 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 261/518] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:54 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:33:55.254700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:55.255347 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:55.261611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.262065 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.262826 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.263294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.391398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:33:55.399015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-00a007e4-b9e1-4752-9118-0d558d8a7daf tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1728 microversion: 2.1 time: 0.148140 May 09 18:33:55.399618 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 258/519] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:33:55 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:33:55.416086 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-103f4788-9000-4af8-9554-6f90980031e3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:33:55.416626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-103f4788-9000-4af8-9554-6f90980031e3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:33:55.422957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-103f4788-9000-4af8-9554-6f90980031e3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.423443 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-103f4788-9000-4af8-9554-6f90980031e3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.424221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-103f4788-9000-4af8-9554-6f90980031e3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:55.424664 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-103f4788-9000-4af8-9554-6f90980031e3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:55.498525 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-103f4788-9000-4af8-9554-6f90980031e3 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086812 May 09 18:33:55.499407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 262/520] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:33:55 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:56.623275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-29b9eee7-3771-47ec-b8ef-b09e9d400cfb req-f61ab809-c94c-479f-877a-d1c8816b3901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a3f8d9-8713-420a-8b24-b30d90e869b6", "tag": "3976c86a-41ed-4aae-b61d-e0d4b31b0fa3"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:56.632363 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-29b9eee7-3771-47ec-b8ef-b09e9d400cfb req-f61ab809-c94c-479f-877a-d1c8816b3901 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:56.632836 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-29b9eee7-3771-47ec-b8ef-b09e9d400cfb req-f61ab809-c94c-479f-877a-d1c8816b3901 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:56.644583 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-29b9eee7-3771-47ec-b8ef-b09e9d400cfb req-f61ab809-c94c-479f-877a-d1c8816b3901 service nova] Creating event network-changed:3976c86a-41ed-4aae-b61d-e0d4b31b0fa3 for instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 on hv-cinder-84112 May 09 18:33:56.650938 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-29b9eee7-3771-47ec-b8ef-b09e9d400cfb req-f61ab809-c94c-479f-877a-d1c8816b3901 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031329 May 09 18:33:56.651767 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 259/521] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:33:58.665312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-e6264d37-bda5-4d4e-aa59-43c66c70a55a req-a2c79578-32ca-4826-9a69-1b1dcaacac30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a3f8d9-8713-420a-8b24-b30d90e869b6", "tag": "3976c86a-41ed-4aae-b61d-e0d4b31b0fa3"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:33:58.673136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e6264d37-bda5-4d4e-aa59-43c66c70a55a req-a2c79578-32ca-4826-9a69-1b1dcaacac30 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:33:58.673582 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e6264d37-bda5-4d4e-aa59-43c66c70a55a req-a2c79578-32ca-4826-9a69-1b1dcaacac30 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:33:58.687247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-e6264d37-bda5-4d4e-aa59-43c66c70a55a req-a2c79578-32ca-4826-9a69-1b1dcaacac30 service nova] Creating event network-changed:3976c86a-41ed-4aae-b61d-e0d4b31b0fa3 for instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 on hv-cinder-84112 May 09 18:33:58.692204 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-e6264d37-bda5-4d4e-aa59-43c66c70a55a req-a2c79578-32ca-4826-9a69-1b1dcaacac30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031008 May 09 18:33:58.692832 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 263/522] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:08.302848 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ae66e6c8-cf4f-412b-a93b-afac1f260e59 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:08.303487 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ae66e6c8-cf4f-412b-a93b-afac1f260e59 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:08.309521 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae66e6c8-cf4f-412b-a93b-afac1f260e59 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.309979 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae66e6c8-cf4f-412b-a93b-afac1f260e59 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.310749 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae66e6c8-cf4f-412b-a93b-afac1f260e59 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.311259 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae66e6c8-cf4f-412b-a93b-afac1f260e59 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.338755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ae66e6c8-cf4f-412b-a93b-afac1f260e59 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments/b73ed524-7295-4487-bfc2-0a8bf0c82753" status: 200 len: 194 microversion: 2.20 time: 0.041331 May 09 18:34:08.339392 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 260/523] 10.222.0.25 () {60 vars in 1453 bytes} [Mon May 9 18:34:08 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments/b73ed524-7295-4487-bfc2-0a8bf0c82753 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:34:08.399711 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:08.400303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:08.406320 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.406780 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.407581 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.408033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.484593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lazy-loading 'services' on Instance uuid 02b5c8d4-23e0-426a-806c-d472fcd826fb {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:08.553682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fa320411-eb9c-4963-bd49-353e2e12a400 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments/b73ed524-7295-4487-bfc2-0a8bf0c82753" status: 202 len: 0 microversion: 2.20 time: 0.158315 May 09 18:34:08.554237 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 264/524] 10.222.0.25 () {60 vars in 1456 bytes} [Mon May 9 18:34:08 2022] DELETE /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments/b73ed524-7295-4487-bfc2-0a8bf0c82753 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:34:08.562727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4652a9c1-27f6-4781-82fd-c1c870809b2b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:08.563757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4652a9c1-27f6-4781-82fd-c1c870809b2b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:08.569569 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4652a9c1-27f6-4781-82fd-c1c870809b2b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.570116 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4652a9c1-27f6-4781-82fd-c1c870809b2b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.571068 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4652a9c1-27f6-4781-82fd-c1c870809b2b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:08.571613 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4652a9c1-27f6-4781-82fd-c1c870809b2b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:08.600840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4652a9c1-27f6-4781-82fd-c1c870809b2b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042233 May 09 18:34:08.601399 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 261/525] 10.222.0.25 () {60 vars in 1342 bytes} [Mon May 9 18:34:08 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 18:34:09.615434 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b23d15ab-0130-4904-a90d-26aa61f71f6c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:09.616524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b23d15ab-0130-4904-a90d-26aa61f71f6c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:09.624489 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b23d15ab-0130-4904-a90d-26aa61f71f6c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.624700 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b23d15ab-0130-4904-a90d-26aa61f71f6c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.625753 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b23d15ab-0130-4904-a90d-26aa61f71f6c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.626473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b23d15ab-0130-4904-a90d-26aa61f71f6c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.656705 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b23d15ab-0130-4904-a90d-26aa61f71f6c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047862 May 09 18:34:09.657467 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 265/526] 10.222.0.25 () {60 vars in 1342 bytes} [Mon May 9 18:34:09 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:09.713674 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:09.714192 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:09.720342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.720798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.721566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.722006 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.746051 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:34:09.816305 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-234c5c72-1c0c-4181-a300-b43e9f46bb3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 204 len: 0 microversion: 2.20 time: 0.106216 May 09 18:34:09.816897 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 262/527] 10.222.0.25 () {60 vars in 1279 bytes} [Mon May 9 18:34:09 2022] DELETE /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 18:34:09.825718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:09.826216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:09.832442 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.833004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.833789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:09.834237 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:09.961020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:09.969627 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:09.971212 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:09.972422 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-354331c5-34dc-4935-bc42-e78d3b745255 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.150706 May 09 18:34:09.972989 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 266/528] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:09 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:10.991808 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:10.992520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:10.999748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:11.000205 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:11.000975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:11.001417 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:11.141980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:11.150364 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:11.151926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:11.153088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-408ddb98-2d1f-44c4-9bb2-39cd4cd110c1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.165632 May 09 18:34:11.153650 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 263/529] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:10 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:12.172009 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:12.172931 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:12.179857 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:12.180319 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:12.181095 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:12.181557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:12.313655 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:12.321982 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:12.323508 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:12.324680 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-426eec54-5bf5-4e09-a370-67ac6fe1df0a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1720 microversion: 2.20 time: 0.156615 May 09 18:34:12.325471 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 267/530] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:12 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:34:12.837888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-950c9504-7425-485b-af99-013d110d58ee req-e0ea13f5-3228-4de7-863e-9893c941a7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5c8d4-23e0-426a-806c-d472fcd826fb", "name": "network-vif-deleted", "tag": "8c59628d-9fbb-446b-9fc4-96acde9b707f"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:12.847056 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-950c9504-7425-485b-af99-013d110d58ee req-e0ea13f5-3228-4de7-863e-9893c941a7ed service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:12.847540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-950c9504-7425-485b-af99-013d110d58ee req-e0ea13f5-3228-4de7-863e-9893c941a7ed service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:12.859122 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-950c9504-7425-485b-af99-013d110d58ee req-e0ea13f5-3228-4de7-863e-9893c941a7ed service nova] Creating event network-vif-deleted:8c59628d-9fbb-446b-9fc4-96acde9b707f for instance 02b5c8d4-23e0-426a-806c-d472fcd826fb on hv-cinder-84112 May 09 18:34:12.864412 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-950c9504-7425-485b-af99-013d110d58ee req-e0ea13f5-3228-4de7-863e-9893c941a7ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030008 May 09 18:34:12.864966 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 264/531] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:13.342750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:13.343407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:13.350018 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:13.350454 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:13.351275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:13.351742 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:13.385328 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:13.385784 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:13.386262 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lazy-loading 'fault' on Instance uuid 02b5c8d4-23e0-426a-806c-d472fcd826fb {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:13.434368 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:13.443855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:13.445370 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:13.446737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-074dcc85-2f9e-493e-8404-2a4d75efce55 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 200 len: 1370 microversion: 2.20 time: 0.107688 May 09 18:34:13.447332 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 268/532] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:13 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 1370 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:14.466568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:14.467301 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:14.473404 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:14.473874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:14.474643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:14.475094 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:14.487803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] HTTP exception thrown: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Request method failure captured: May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb HTTP/1.1 May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV3eSqepJM5HWXs3AwBEpmZaYajVAFCMHljS8YRHDQ2dIujb4Fyn6Hr709c_WzUzeQLCORbY7F0_TdgdvZoHGrVZNFVfRBf8JnYhyaa-ZK7NGVfC4hF5hHAG8U9w3wOvkeothpEGEivpURLCXFc2B7l8Vejq4S4NXX5UKlOmbht2Pdk May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 127c608e5ebd478282b045739182c41e May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:34:14.489398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/127c608e5ebd478282b045739182c41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_127c608e5ebd478282b045739182c41e"}]}] May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 127c608e5ebd478282b045739182c41e May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: cac32da403af402c8236f46168e81038 May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:34:14.490972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '02b5c8d4-23e0-426a-806c-d472fcd826fb'} May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:34:14.491804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:34:14.492945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:14.494002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Returning 404 to user: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:34:14.494002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2914d8f7-c1a6-4133-8a67-d9254fee4131 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 404 len: 111 microversion: 2.20 time: 0.028980 May 09 18:34:14.494002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 265/533] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:14 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:34:14.499736 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-94386095-f118-47ee-a9de-c91a937d0891 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '.version_select at 0x7f3f7e8655e0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:14.517758 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-94386095-f118-47ee-a9de-c91a937d0891 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888096569" status: 204 len: 0 microversion: 2.20 time: 0.022026 May 09 18:34:14.518300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 269/534] 10.222.0.25 () {60 vars in 1258 bytes} [Mon May 9 18:34:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888096569 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 18:34:15.120467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74cc1825-1d13-4e7b-a9eb-e8d4f9601534 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'create', calling method: .version_select at 0x7f3f7e7f9dc0>, body: {"keypair": {"name": "tempest-keypair-1132992640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsVH9CVNm5E/nlcaevAan2NbZixNiKR9I8SAhEBvni/LyM6D+/GPx+WgzdHXSoRqkppnfxLVYRE+C4tfwR9EDmJw/AeoJ0FGtaJbq/H3gl4isxc3c7MZ+2wms5dENPkJg=="}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:15.135676 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-74cc1825-1d13-4e7b-a9eb-e8d4f9601534 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for project 127c608e5ebd478282b045739182c41e. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:15.139368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-74cc1825-1d13-4e7b-a9eb-e8d4f9601534 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for user cac32da403af402c8236f46168e81038 and project 127c608e5ebd478282b045739182c41e. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:15.160252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-74cc1825-1d13-4e7b-a9eb-e8d4f9601534 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045212 May 09 18:34:15.160851 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 266/535] 10.222.0.25 () {62 vars in 1199 bytes} [Mon May 9 18:34:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 09 18:34:16.361862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-70302990", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5e8d460-3fdc-4b49-8c18-f792777a0c26"}], "security_groups": [{"name": "tempest-securitygroup--1496222462"}], "key_name": "tempest-keypair-1132992640", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:16.460646 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] validate_networks() for [('f5e8d460-3fdc-4b49-8c18-f792777a0c26', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:34:16.820169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:34:16.820607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:34:16.821093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:34:16.821504 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:34:16.821924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:34:16.830413 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:16.830873 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:16.831725 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:16.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:16.848675 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for project 127c608e5ebd478282b045739182c41e. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:16.852567 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Getting quotas for user cac32da403af402c8236f46168e81038 and project 127c608e5ebd478282b045739182c41e. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:16.863005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:34:16.865276 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:34:16.910635 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3b5681ca-3905-4a0c-adec-70a25be4e1e8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.553063 May 09 18:34:16.911346 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 270/536] 10.222.0.25 () {62 vars in 1187 bytes} [Mon May 9 18:34:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 18:34:16.921391 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-27a850dc-210d-40c5-93e1-6e63269f3f88 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:16.922100 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-27a850dc-210d-40c5-93e1-6e63269f3f88 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:16.975976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-27a850dc-210d-40c5-93e1-6e63269f3f88 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:16.984066 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-27a850dc-210d-40c5-93e1-6e63269f3f88 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:16.985601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-27a850dc-210d-40c5-93e1-6e63269f3f88 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:16.986709 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-27a850dc-210d-40c5-93e1-6e63269f3f88 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1280 microversion: 2.20 time: 0.069272 May 09 18:34:16.987281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 267/537] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:16 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:18.005682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:18.006424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:18.013129 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.013669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:18.014548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:18.015218 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:18.077576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:18.086137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:18.087681 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:18.088796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-15aa7bf1-7033-45b2-9c7b-711564e4db56 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1350 microversion: 2.20 time: 0.087764 May 09 18:34:18.089353 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 271/538] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:17 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:19.107691 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:19.108314 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:19.126139 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:19.126603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:19.127416 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:19.127874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:19.265529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:19.276188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:19.278408 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:19.280033 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8f0853ae-25aa-4e05-829c-8d255b70c14c tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1406 microversion: 2.20 time: 0.176336 May 09 18:34:19.290887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 268/539] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:19 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:19.296417 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-c4cd23ea-742e-4a08-92d9-cb3949e7b1ae req-bc48b74b-7fcc-47b8-8e4f-ca23e9783f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd17ee8-9df4-4b0b-b150-574fed351dde", "tag": "24ac401c-c8b4-41af-97fa-c5c82f0aa6b7"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:19.310727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c4cd23ea-742e-4a08-92d9-cb3949e7b1ae req-bc48b74b-7fcc-47b8-8e4f-ca23e9783f92 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:19.311309 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c4cd23ea-742e-4a08-92d9-cb3949e7b1ae req-bc48b74b-7fcc-47b8-8e4f-ca23e9783f92 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:19.328228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-c4cd23ea-742e-4a08-92d9-cb3949e7b1ae req-bc48b74b-7fcc-47b8-8e4f-ca23e9783f92 service nova] Creating event network-changed:24ac401c-c8b4-41af-97fa-c5c82f0aa6b7 for instance edd17ee8-9df4-4b0b-b150-574fed351dde on hv-cinder-84112 May 09 18:34:19.334087 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-c4cd23ea-742e-4a08-92d9-cb3949e7b1ae req-bc48b74b-7fcc-47b8-8e4f-ca23e9783f92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041234 May 09 18:34:19.334729 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 272/540] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:20.297750 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:20.298374 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:20.304713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:20.305174 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:20.305941 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:20.306386 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:20.349000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-15b170cf-dcb9-49d5-bea4-50f2239267c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:20.349587 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-15b170cf-dcb9-49d5-bea4-50f2239267c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:20.355831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15b170cf-dcb9-49d5-bea4-50f2239267c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:20.356289 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15b170cf-dcb9-49d5-bea4-50f2239267c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:20.357074 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15b170cf-dcb9-49d5-bea4-50f2239267c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:20.357518 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15b170cf-dcb9-49d5-bea4-50f2239267c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:20.380272 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-15b170cf-dcb9-49d5-bea4-50f2239267c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/ips" status: 200 len: 151 microversion: 2.1 time: 0.036404 May 09 18:34:20.380850 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 273/541] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:34:20 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:20.445739 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:20.453406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:20.454919 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:20.456370 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d63b6c1a-0695-4b45-b936-3a6d70a3e697 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1406 microversion: 2.20 time: 0.162486 May 09 18:34:20.456940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 269/542] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:20 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:21.474744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:21.475397 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:21.481614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:21.482076 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:21.482855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:21.483321 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:21.613439 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:21.621234 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:21.622759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:21.624161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5a2cc802-c85b-44a3-b5f4-ad5f7f39d07d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1406 microversion: 2.20 time: 0.153872 May 09 18:34:21.624725 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 274/543] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:21 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:21.683722 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e8c93daa-c510-4bc8-a460-8de31dba676f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc7f7426-ec6a-4745-b4a4-fff35abe5718"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:21.684803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e8c93daa-c510-4bc8-a460-8de31dba676f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:21.691130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8c93daa-c510-4bc8-a460-8de31dba676f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:21.691568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8c93daa-c510-4bc8-a460-8de31dba676f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:21.692368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8c93daa-c510-4bc8-a460-8de31dba676f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:21.692792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e8c93daa-c510-4bc8-a460-8de31dba676f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:21.946946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e8c93daa-c510-4bc8-a460-8de31dba676f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266824 May 09 18:34:21.947527 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 270/544] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:34:21 2022] POST /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:22.642755 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:22.643622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:22.650377 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:22.650833 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:22.651644 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:22.652085 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:22.780806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:22.789015 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:22.790611 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:22.791765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7d40a49c-8bf3-463a-885c-b87956f7a3e1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1406 microversion: 2.20 time: 0.153317 May 09 18:34:22.792334 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 275/545] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:22 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:23.013814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-14f4471a-b560-4c4a-a3bf-6bbca745c278 req-9b46aa7a-64c5-4276-92a5-c67ac14255f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd17ee8-9df4-4b0b-b150-574fed351dde", "name": "network-vif-plugged", "status": "completed", "tag": "24ac401c-c8b4-41af-97fa-c5c82f0aa6b7"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:23.022595 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-14f4471a-b560-4c4a-a3bf-6bbca745c278 req-9b46aa7a-64c5-4276-92a5-c67ac14255f4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:23.023048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-14f4471a-b560-4c4a-a3bf-6bbca745c278 req-9b46aa7a-64c5-4276-92a5-c67ac14255f4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:23.034546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-14f4471a-b560-4c4a-a3bf-6bbca745c278 req-9b46aa7a-64c5-4276-92a5-c67ac14255f4 service nova] Creating event network-vif-plugged:24ac401c-c8b4-41af-97fa-c5c82f0aa6b7 for instance edd17ee8-9df4-4b0b-b150-574fed351dde on hv-cinder-84112 May 09 18:34:23.039847 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-14f4471a-b560-4c4a-a3bf-6bbca745c278 req-9b46aa7a-64c5-4276-92a5-c67ac14255f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 May 09 18:34:23.040779 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 271/546] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:23.809851 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:23.810467 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:23.816836 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:23.817937 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:23.818708 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:23.819150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:23.941461 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:23.949753 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:23.951279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:23.952369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3476766b-544e-4b54-ba2a-29d215e34698 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1406 microversion: 2.20 time: 0.146399 May 09 18:34:23.952921 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 276/547] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:23 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:24.970452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:24.971170 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:24.977337 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:24.977805 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:24.978588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:24.979064 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:25.106652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:25.114899 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:25.116441 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:25.117551 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6c32d757-b508-4de6-b13c-732e31c90b83 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1406 microversion: 2.20 time: 0.151852 May 09 18:34:25.118364 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 272/548] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:24 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:26.135821 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:26.136372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:26.142795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.143271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.144042 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.144486 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.221175 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:26.221796 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:26.228782 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.229245 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.230020 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.230465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.252611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lazy-loading 'flavor' on Instance uuid 8243cbea-6bde-4ac9-8f5a-53ec888ed813 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:26.273462 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:26.281296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:26.282826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:26.284033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a28a255f-2601-48e2-a882-8859f9387256 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1598 microversion: 2.20 time: 0.152205 May 09 18:34:26.284602 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 277/549] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:34:26 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:34:26.301536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-48554109-f0f8-41bc-881c-40aba7fdd5c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:26.302078 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-48554109-f0f8-41bc-881c-40aba7fdd5c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:26.307958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48554109-f0f8-41bc-881c-40aba7fdd5c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.308425 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48554109-f0f8-41bc-881c-40aba7fdd5c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.309216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48554109-f0f8-41bc-881c-40aba7fdd5c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.309767 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48554109-f0f8-41bc-881c-40aba7fdd5c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.323812 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-07fe82ed-1b54-4ff4-9e87-ad46984c6920 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "POST /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813/action" status: 202 len: 0 microversion: 2.1 time: 0.106027 May 09 18:34:26.324529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 273/550] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:34:26 2022] POST /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 18:34:26.333655 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:26.334712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:26.341373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.341969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.342894 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:26.343546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:26.388699 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-48554109-f0f8-41bc-881c-40aba7fdd5c4 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090821 May 09 18:34:26.389307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 278/551] 10.222.0.25 () {60 vars in 1315 bytes} [Mon May 9 18:34:26 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:34:26.487952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:26.495550 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e292618c-35a3-48fd-9d25-bbc403193b6c tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.166558 May 09 18:34:26.496142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 274/552] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:26 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:27.514004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:27.514662 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:27.520602 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:27.521060 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:27.521833 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:27.522277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:27.571358 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-557600ba-4d93-4968-956d-bde04a1f000c req-9e19d6ba-10be-4f93-af45-60522d1e39ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd17ee8-9df4-4b0b-b150-574fed351dde", "tag": "24ac401c-c8b4-41af-97fa-c5c82f0aa6b7"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:27.579767 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-557600ba-4d93-4968-956d-bde04a1f000c req-9e19d6ba-10be-4f93-af45-60522d1e39ab service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:27.580222 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-557600ba-4d93-4968-956d-bde04a1f000c req-9e19d6ba-10be-4f93-af45-60522d1e39ab service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:27.591570 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-557600ba-4d93-4968-956d-bde04a1f000c req-9e19d6ba-10be-4f93-af45-60522d1e39ab service nova] Creating event network-changed:24ac401c-c8b4-41af-97fa-c5c82f0aa6b7 for instance edd17ee8-9df4-4b0b-b150-574fed351dde on hv-cinder-84112 May 09 18:34:27.596639 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-557600ba-4d93-4968-956d-bde04a1f000c req-9e19d6ba-10be-4f93-af45-60522d1e39ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028807 May 09 18:34:27.597510 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 275/553] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:27.662923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:27.670435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2fdb7e86-8206-42c6-8402-96f17a1194ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.160672 May 09 18:34:27.671016 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 279/554] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:27 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:28.688503 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:28.689246 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:28.699815 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:28.700284 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:28.705100 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:28.705813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:28.850304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:28.859580 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-141b6a01-3a06-4a5a-8c21-289c2e924df7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.175719 May 09 18:34:28.860402 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 276/555] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:28 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:29.440137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc7f7426-ec6a-4745-b4a4-fff35abe5718"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:29.441245 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:29.448140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.448593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:29.449364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.449801 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:29.525036 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Invalid volume: volume fc7f7426-ec6a-4745-b4a4-fff35abe5718 is already attached to instances: ed8b23f6-bf09-4784-bed1-4e2a9c013f91 May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: POST /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments HTTP/1.1 May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 74 May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:34:29.526744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {"volumeAttachment": {"volumeId": "fc7f7426-ec6a-4745-b4a4-fff35abe5718"}} May 09 18:34:29.528306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Invalid volume: volume fc7f7426-ec6a-4745-b4a4-fff35abe5718 is already attached to instances: ed8b23f6-bf09-4784-bed1-4e2a9c013f91 May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'server_id': 'ed8b23f6-bf09-4784-bed1-4e2a9c013f91', 'body': {'volumeAttachment': {'volumeId': 'fc7f7426-ec6a-4745-b4a4-fff35abe5718'}}} May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fc7f7426-ec6a-4745-b4a4-fff35abe5718 is already attached to instances: ed8b23f6-bf09-4784-bed1-4e2a9c013f91 May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:29.529140 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fc7f7426-ec6a-4745-b4a4-fff35abe5718 is already attached to instances: ed8b23f6-bf09-4784-bed1-4e2a9c013f91 May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:29.530385 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fc7f7426-ec6a-4745-b4a4-fff35abe5718 is already attached to instances: ed8b23f6-bf09-4784-bed1-4e2a9c013f91 May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 400 to user: Invalid volume: volume fc7f7426-ec6a-4745-b4a4-fff35abe5718 is already attached to instances: ed8b23f6-bf09-4784-bed1-4e2a9c013f91 {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-37feee09-9ef1-419e-9258-634c68117ca4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092121 May 09 18:34:29.531588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 280/556] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:34:29 2022] POST /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 18:34:29.586786 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:29.587324 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:29.593237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.593641 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:29.594414 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.594865 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:29.673659 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lazy-loading 'services' on Instance uuid ed8b23f6-bf09-4784-bed1-4e2a9c013f91 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:29.746601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9339f313-9f7a-4263-9383-a6020bd7866c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments/fc7f7426-ec6a-4745-b4a4-fff35abe5718" status: 202 len: 0 microversion: 2.1 time: 0.163743 May 09 18:34:29.747371 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 277/557] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:34:29 2022] DELETE /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments/fc7f7426-ec6a-4745-b4a4-fff35abe5718 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:29.755829 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-db33a637-7417-4b06-9677-bfa27a9635a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:29.756836 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-db33a637-7417-4b06-9677-bfa27a9635a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:29.762978 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db33a637-7417-4b06-9677-bfa27a9635a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.763487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db33a637-7417-4b06-9677-bfa27a9635a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:29.764459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db33a637-7417-4b06-9677-bfa27a9635a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.765053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db33a637-7417-4b06-9677-bfa27a9635a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:29.795291 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-db33a637-7417-4b06-9677-bfa27a9635a2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 May 09 18:34:29.795842 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 281/558] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:34:29 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:29.878304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:29.879013 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:29.885037 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.885493 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:29.886264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:29.886704 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:30.017332 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:30.025197 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-924fe50c-6eed-4f23-aa11-39aa0ea2f3aa tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.151034 May 09 18:34:30.025765 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 278/559] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:29 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:30.807162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4f82f4b7-ed48-443d-8008-5fc8a3b2905d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:30.808111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4f82f4b7-ed48-443d-8008-5fc8a3b2905d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:30.814483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f82f4b7-ed48-443d-8008-5fc8a3b2905d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:30.814940 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f82f4b7-ed48-443d-8008-5fc8a3b2905d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:30.815741 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f82f4b7-ed48-443d-8008-5fc8a3b2905d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:30.816185 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f82f4b7-ed48-443d-8008-5fc8a3b2905d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:30.850267 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4f82f4b7-ed48-443d-8008-5fc8a3b2905d tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046991 May 09 18:34:30.850816 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 282/560] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:34:30 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:34:30.906695 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:30.907230 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:30.913613 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:30.914101 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:30.914869 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:30.915350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:30.940868 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:34:31.015960 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a38a5683-c1c7-485e-874b-9ae4ca88a070 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 204 len: 0 microversion: 2.1 time: 0.112729 May 09 18:34:31.016689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 279/561] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:34:30 2022] DELETE /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:34:31.025208 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:31.025840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:31.032228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:31.032694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:31.033476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:31.033929 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:31.042606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:31.043349 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:31.049052 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:31.049515 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:31.050287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:31.050735 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:31.229074 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:31.232718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:31.236475 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6ac61d18-f4c4-4399-a15e-e6a75af11ef6 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1682 microversion: 2.1 time: 0.215205 May 09 18:34:31.237049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 283/562] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:31 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:31.241737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cfd546e8-653e-49a8-b1c0-99aafe1ae329 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.202358 May 09 18:34:31.241737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 280/563] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:31 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:32.257887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:32.258449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:32.258834 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:32.258940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:32.264712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:32.264855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:32.265166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:32.265284 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:32.265931 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:32.266029 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:32.266370 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:32.266483 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:32.464441 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:32.467988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:32.471832 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fd4571b0-92ef-4b49-8c6a-e755b3020289 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1682 microversion: 2.1 time: 0.218453 May 09 18:34:32.472395 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 284/564] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:32 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:32.475749 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a6d8a594-e1ae-4205-988e-cb7d05b628f0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.221678 May 09 18:34:32.476307 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 281/565] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:32 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:33.489296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:33.489954 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:33.492610 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:33.493226 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:33.496339 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:33.496765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:33.497588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:33.498031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:33.500895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:33.501551 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:33.502725 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:33.503199 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:33.584818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:33.592544 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e42f1fee-b180-4a7a-a436-faa4035591f3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 200 len: 1614 microversion: 2.1 time: 0.107208 May 09 18:34:33.593318 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 285/566] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:33 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 1614 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:33.662990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:33.671132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5f13c864-bbd0-4530-a19c-0b967c66333f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.182669 May 09 18:34:33.672046 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 282/567] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:33 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:33.673156 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-8d984ab6-536d-47d8-b3b3-2641a3793a1d req-3fa5aec0-a3de-4086-98c8-7a01ec339abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8b23f6-bf09-4784-bed1-4e2a9c013f91", "name": "network-vif-deleted", "tag": "3cc28631-1ce9-4cb9-a981-f1bca63f379d"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:33.681552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-8d984ab6-536d-47d8-b3b3-2641a3793a1d req-3fa5aec0-a3de-4086-98c8-7a01ec339abc service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:33.682249 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-8d984ab6-536d-47d8-b3b3-2641a3793a1d req-3fa5aec0-a3de-4086-98c8-7a01ec339abc service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:33.694092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-8d984ab6-536d-47d8-b3b3-2641a3793a1d req-3fa5aec0-a3de-4086-98c8-7a01ec339abc service nova] Creating event network-vif-deleted:3cc28631-1ce9-4cb9-a981-f1bca63f379d for instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 on hv-cinder-84112 May 09 18:34:33.699810 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-8d984ab6-536d-47d8-b3b3-2641a3793a1d req-3fa5aec0-a3de-4086-98c8-7a01ec339abc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030053 May 09 18:34:33.703483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 286/568] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:34.502410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:34.502898 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:34.509322 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.509985 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.510770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.511237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.591793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lazy-loading 'services' on Instance uuid 73a3f8d9-8713-420a-8b24-b30d90e869b6 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:34.610807 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:34.611640 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:34.618479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.619009 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.619824 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.620266 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.634535 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 HTTP/1.1 May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:34:34.636244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:34:34.637536 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'ed8b23f6-bf09-4784-bed1-4e2a9c013f91'} May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:34:34.638483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:34:34.639900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:34.641068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:34:34.641068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-64adc9d1-0404-41a4-aa92-a7df630aa0d8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 404 len: 111 microversion: 2.1 time: 0.031759 May 09 18:34:34.642402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 287/569] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:34 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 18:34:34.647287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-17bc3fa5-b45f-4b2d-bc05-6cd3dd4d2fcc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '.version_select at 0x7f3f7e711790>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:34.669832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4078732c-1432-49e2-8764-8c78d320e0d8 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments/2c490f8a-6329-4f12-8ed3-9c8b6d14eed3" status: 202 len: 0 microversion: 2.1 time: 0.171372 May 09 18:34:34.670683 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 283/570] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:34:34 2022] DELETE /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments/2c490f8a-6329-4f12-8ed3-9c8b6d14eed3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:34.676599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-17bc3fa5-b45f-4b2d-bc05-6cd3dd4d2fcc tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959670274" status: 202 len: 0 microversion: 2.1 time: 0.033708 May 09 18:34:34.678187 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 288/571] 10.222.0.25 () {58 vars in 1217 bytes} [Mon May 9 18:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959670274 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:34.681200 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cd958ab7-6739-4454-86e8-f47edc0decf4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:34.684718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cd958ab7-6739-4454-86e8-f47edc0decf4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:34.692048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd958ab7-6739-4454-86e8-f47edc0decf4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.692854 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd958ab7-6739-4454-86e8-f47edc0decf4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.694330 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd958ab7-6739-4454-86e8-f47edc0decf4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.694954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd958ab7-6739-4454-86e8-f47edc0decf4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.696263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:34.697200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:34.712181 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.712958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.714211 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:34.714866 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:34.731637 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cd958ab7-6739-4454-86e8-f47edc0decf4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055060 May 09 18:34:34.732652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 284/572] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:34:34 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:34.870241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:34.878765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-622c6e01-bf90-422e-a370-8778a0f243ed tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.190235 May 09 18:34:34.880259 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 289/573] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:34 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:35.358293 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-78885dbc-95ed-4f5e-aa2a-3cbc8217b9a9 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: .version_select at 0x7f3f7e6ce700>, body: {"keypair": {"name": "tempest-keypair-1881396961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH4TytQgltW9UHq59eL5mMykCBJapDZd5tY3jvk3BDjlivux/4ldkSZh2W4pV4s1W2+7z/2OlS/8tVDuPhXIlY1YVzu223aBYntFI94NThKafeNcGi4sE46HAYpZXxQFA=="}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:35.371560 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-78885dbc-95ed-4f5e-aa2a-3cbc8217b9a9 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:35.375496 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-78885dbc-95ed-4f5e-aa2a-3cbc8217b9a9 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:35.396062 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-78885dbc-95ed-4f5e-aa2a-3cbc8217b9a9 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.041580 May 09 18:34:35.396652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 285/574] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:34:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:35.743277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b511f120-e047-431a-8470-2d20a1fd1851 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:35.744221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b511f120-e047-431a-8470-2d20a1fd1851 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:35.750789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b511f120-e047-431a-8470-2d20a1fd1851 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:35.751300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b511f120-e047-431a-8470-2d20a1fd1851 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:35.752106 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b511f120-e047-431a-8470-2d20a1fd1851 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:35.752558 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b511f120-e047-431a-8470-2d20a1fd1851 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:35.785603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b511f120-e047-431a-8470-2d20a1fd1851 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046387 May 09 18:34:35.786264 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 290/575] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:34:35 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:34:35.856013 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:35.856570 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:35.862187 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:35.862643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:35.863445 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:35.864467 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:35.892157 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:34:35.896560 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:35.897242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:35.903043 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:35.903535 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:35.904309 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:35.904756 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:35.992777 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ed541ee9-d5dd-407e-92da-9f688263a489 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 204 len: 0 microversion: 2.1 time: 0.140853 May 09 18:34:35.993589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 286/576] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:34:35 2022] DELETE /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:34:36.002251 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:36.003220 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:36.009889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:36.010438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:36.011465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:36.011922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:36.240913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:36.248651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5f793432-18b5-4704-af92-06e5baedb5e1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.355526 May 09 18:34:36.249151 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 291/577] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:35 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:36.279788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:36.287786 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-17ee76fa-25aa-4a02-9bed-e5cc4f4ab8dc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1688 microversion: 2.1 time: 0.290037 May 09 18:34:36.288361 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 287/578] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:35 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1688 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:36.766368 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-930492668", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "301e94ce-a989-4fe3-9992-0fa06fbc5e5e"}], "security_groups": [{"name": "tempest-securitygroup--594805022"}], "key_name": "tempest-keypair-1881396961", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:36.864493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] validate_networks() for [('301e94ce-a989-4fe3-9992-0fa06fbc5e5e', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:34:37.221313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:34:37.221747 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:34:37.222232 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:34:37.222666 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:34:37.223090 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:34:37.231818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:37.232277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:37.233097 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:37.233543 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:37.250402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:37.254842 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Getting quotas for user f99208187e4e4d2eb9f52107ae8f50f2 and project 3582c1a023c645b38b91a5fa01be7667. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:37.265420 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:37.266172 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:37.266348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:34:37.268712 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:34:37.273364 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:37.273896 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:37.274747 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:37.275295 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:37.322431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b014e9a6-6c02-48d4-881d-38fa1768ebce tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.560348 May 09 18:34:37.323566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 292/579] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:34:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:34:37.327609 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:37.328227 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:37.334282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:37.334784 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:37.335576 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:37.335979 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:37.473900 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:37.481481 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bfce3060-a2e2-4648-afe3-82d28e648407 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.219825 May 09 18:34:37.482305 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 288/580] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:37 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:37.487478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-551d8391-2b08-4071-8f42-dff7b492cbd8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:37.488979 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-551d8391-2b08-4071-8f42-dff7b492cbd8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:37.503563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:37.511878 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-413de366-2e79-4f91-82ce-b8268b744f84 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1688 microversion: 2.1 time: 0.187788 May 09 18:34:37.512648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 293/581] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:37 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:37.549064 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-551d8391-2b08-4071-8f42-dff7b492cbd8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:37.556216 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-551d8391-2b08-4071-8f42-dff7b492cbd8 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1241 microversion: 2.1 time: 0.072745 May 09 18:34:37.556880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 289/582] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:37 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:38.499593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:38.500207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:38.506647 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:38.507112 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:38.507925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:38.508376 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:38.528838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:38.529562 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:38.536831 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:38.537287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:38.538070 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:38.538510 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:38.697372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:38.705409 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cbe2d58e-e48d-48b3-baae-b22894777d39 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.209324 May 09 18:34:38.714555 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 294/583] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:38 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:38.714654 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:38.714770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:38.714770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:38.716134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0099f5eb-1b2e-4ed0-a412-66170306e4a0 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1688 microversion: 2.1 time: 0.191046 May 09 18:34:38.716393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:38.716705 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 290/584] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:38 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:38.716854 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:38.717618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:38.718065 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:38.777642 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:38.785069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a43a35fa-25d7-45b4-af34-ddb85d995763 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1245 microversion: 2.1 time: 0.078244 May 09 18:34:38.786189 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 295/585] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:38 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:39.711345 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:34:39.712121 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Mon May 9 18:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:34:39.721649 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:39.722471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:39.734084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:39.735025 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:39.743366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:39.744175 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:39.745183 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:39.745842 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:39.746050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:39.746847 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:39.748194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:39.748804 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:40.325759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:40.333745 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:40.335502 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0fd9f12d-8c5a-459e-8b7f-d203eb89483d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1688 microversion: 2.1 time: 0.605850 May 09 18:34:40.345534 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-00356304-d540-43d8-aeb9-71976484c0ca tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.625749 May 09 18:34:40.345534 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 291/586] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:39 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:40.346382 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 296/587] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:39 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1688 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:40.353561 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:40.354560 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:40.360683 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:40.361352 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:40.362146 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:40.362599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:40.499311 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:40.506814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-46bd576b-3b11-4bd1-974c-2bdcc0f1d681 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1299 microversion: 2.1 time: 0.157219 May 09 18:34:40.507791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 292/588] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:40 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:41.171957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-a7185151-5f16-4243-8d19-feb4a57399e2 req-e022a233-2028-44d3-b518-cac6c5908b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a3f8d9-8713-420a-8b24-b30d90e869b6", "name": "network-vif-deleted", "tag": "3976c86a-41ed-4aae-b61d-e0d4b31b0fa3"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:41.181866 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-a7185151-5f16-4243-8d19-feb4a57399e2 req-e022a233-2028-44d3-b518-cac6c5908b5d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:41.182581 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-a7185151-5f16-4243-8d19-feb4a57399e2 req-e022a233-2028-44d3-b518-cac6c5908b5d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:41.205812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-a7185151-5f16-4243-8d19-feb4a57399e2 req-e022a233-2028-44d3-b518-cac6c5908b5d service nova] Creating event network-vif-deleted:3976c86a-41ed-4aae-b61d-e0d4b31b0fa3 for instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 on hv-cinder-84112 May 09 18:34:41.211680 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-a7185151-5f16-4243-8d19-feb4a57399e2 req-e022a233-2028-44d3-b518-cac6c5908b5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043365 May 09 18:34:41.212367 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 297/589] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:41.352444 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:41.353166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:41.362514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:41.362732 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:41.363951 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:41.364692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:41.364832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:41.365367 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:41.380521 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:41.381012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:41.381848 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:41.382463 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:41.434478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:41.442991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cf769d57-57be-4bef-bece-bb2f3d0db197 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1621 microversion: 2.1 time: 0.094362 May 09 18:34:41.451387 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 293/590] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:41 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1621 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:41.523889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:41.524593 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:41.531165 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:41.531942 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:41.532976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:41.533588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:41.543578 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:41.552911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9541ce60-161e-4c9d-af23-101f1dd93437 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.195443 May 09 18:34:41.553943 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 298/591] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:41 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:41.661291 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:41.668574 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bcc093b8-fc60-438a-bb1b-2101e47b3073 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.148380 May 09 18:34:41.669348 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 294/592] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:41 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:42.460329 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:42.461136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:42.467796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.468404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.469487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.470045 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.504241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.504699 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.505165 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lazy-loading 'fault' on Instance uuid 73a3f8d9-8713-420a-8b24-b30d90e869b6 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:42.564563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:42.571109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:42.572698 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-92025c9f-3117-4271-b602-bd494ef5bc4d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 200 len: 1335 microversion: 2.1 time: 0.115703 May 09 18:34:42.572939 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:42.575221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 299/593] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:42 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 1335 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:42.587962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.588607 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.590015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.592047 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.595945 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-e5f50203-ab0d-427a-a0cd-5e4b2f2a0a5c req-84f8cd9e-2663-49d0-8d67-a1ef9b32169b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a95113e2-f278-45ae-afa3-7d1bee1e08a1", "tag": "6565f8c1-96d5-4ffe-82fd-eba43170e663"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:42.606297 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e5f50203-ab0d-427a-a0cd-5e4b2f2a0a5c req-84f8cd9e-2663-49d0-8d67-a1ef9b32169b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.607366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e5f50203-ab0d-427a-a0cd-5e4b2f2a0a5c req-84f8cd9e-2663-49d0-8d67-a1ef9b32169b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.621428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-e5f50203-ab0d-427a-a0cd-5e4b2f2a0a5c req-84f8cd9e-2663-49d0-8d67-a1ef9b32169b service nova] Creating event network-changed:6565f8c1-96d5-4ffe-82fd-eba43170e663 for instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 on hv-cinder-84112 May 09 18:34:42.653040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-e5f50203-ab0d-427a-a0cd-5e4b2f2a0a5c req-84f8cd9e-2663-49d0-8d67-a1ef9b32169b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059248 May 09 18:34:42.654797 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 300/594] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:42.691642 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:42.692418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:42.709667 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.710220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.711068 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:42.711551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:42.871060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:42.879036 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1e4443e9-b216-4068-a20e-e745e3311185 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.312826 May 09 18:34:42.879644 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 295/595] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:42 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:42.949318 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:42.968285 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9f3f3acf-53f8-4206-8631-59c88883d2e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.283115 May 09 18:34:42.971222 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 301/596] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:42 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:43.591860 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:43.592431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 73a3f8d9-8713-420a-8b24-b30d90e869b6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:43.598978 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:43.599470 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:43.600252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:43.600697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:43.614471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] HTTP exception thrown: Instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 could not be found. May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Request method failure captured: May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 HTTP/1.1 May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2kHVKHC70jbdtlqcLtqCx7g8VL5Ug9a38m55Hd4sd7xI_aKp02cfltlH8kw6KHcPBWVNk_QCErJ0e4HWOjTcdH2NE1e3exEo9xfCwZYUBGt44Ky1nFiqcOLtH0XYYWol2eIWyOxRXndYcydWBN4_V5euBVPzJagYjI7UZEWWpXOsM May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:34:43.616154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_705eecf37fcc4fe7aabef923ece6ad59"}]}] May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: acae3ad19a7e45b9877520dff8f5b995 May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 could not be found. May 09 18:34:43.617838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '73a3f8d9-8713-420a-8b24-b30d90e869b6'} May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 could not be found. May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:34:43.618719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 could not be found. May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 could not be found. May 09 18:34:43.620123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:34:43.621748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Returning 404 to user: Instance 73a3f8d9-8713-420a-8b24-b30d90e869b6 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:34:43.621748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e1a2a466-d1bf-4403-918d-e372064ab7ce tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6" status: 404 len: 111 microversion: 2.1 time: 0.029680 May 09 18:34:43.621748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 296/597] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:43 2022] GET /compute/v2.1/servers/73a3f8d9-8713-420a-8b24-b30d90e869b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:34:43.626503 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a2f7aba4-979c-4aae-9333-07aa7d176c07 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '.version_select at 0x7f3f7e6e3310>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:43.643782 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a2f7aba4-979c-4aae-9333-07aa7d176c07 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702182038" status: 202 len: 0 microversion: 2.1 time: 0.021243 May 09 18:34:43.644261 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 302/598] 10.222.0.25 () {58 vars in 1217 bytes} [Mon May 9 18:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702182038 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:43.896164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:43.896706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:43.902425 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:43.902889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:43.903693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:43.904153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:43.987531 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:43.988898 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:43.995007 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:43.995505 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:43.996460 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:43.996902 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.036420 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:44.044321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c7e1daab-9168-49ab-9a9d-4181832122b1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1568 microversion: 2.1 time: 0.152005 May 09 18:34:44.045290 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 297/599] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:43 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:44.062886 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ccfc08e4-5757-449d-9e0d-efdb3b0396d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:44.063511 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ccfc08e4-5757-449d-9e0d-efdb3b0396d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:44.070912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ccfc08e4-5757-449d-9e0d-efdb3b0396d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.071689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ccfc08e4-5757-449d-9e0d-efdb3b0396d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.072737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ccfc08e4-5757-449d-9e0d-efdb3b0396d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.073190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ccfc08e4-5757-449d-9e0d-efdb3b0396d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.145394 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:44.153150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c8ad702b-a8a6-4d9d-af7a-ce140170129a tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.169825 May 09 18:34:44.162897 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 303/600] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:43 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:44.226589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ccfc08e4-5757-449d-9e0d-efdb3b0396d8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "POST /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813/action" status: 202 len: 0 microversion: 2.1 time: 0.167836 May 09 18:34:44.227256 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 298/601] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:34:44 2022] POST /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:44.235710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:44.236470 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:44.243165 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.243951 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.244822 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:44.245723 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:44.394861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:44.402695 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-772f0804-af33-48db-8597-67ca6bb8e8cf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1576 microversion: 2.1 time: 0.171236 May 09 18:34:44.403436 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 304/602] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:44 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:45.170513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:45.171832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:45.179482 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:45.179952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:45.180744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:45.181187 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:45.308235 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-13ffe6f2-8262-44a6-86cb-39aa9bb30dad req-54d1cc3c-4200-469f-8a56-a18c54e6b5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8243cbea-6bde-4ac9-8f5a-53ec888ed813", "name": "network-vif-unplugged", "status": "completed", "tag": "c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:45.321421 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-13ffe6f2-8262-44a6-86cb-39aa9bb30dad req-54d1cc3c-4200-469f-8a56-a18c54e6b5fd service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:45.322223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-13ffe6f2-8262-44a6-86cb-39aa9bb30dad req-54d1cc3c-4200-469f-8a56-a18c54e6b5fd service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:45.335557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.compute.server_external_events [req-13ffe6f2-8262-44a6-86cb-39aa9bb30dad req-54d1cc3c-4200-469f-8a56-a18c54e6b5fd service nova] Unable to find a host for instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813. Dropping event network-vif-unplugged {{(pid=117087) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 18:34:45.337309 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-13ffe6f2-8262-44a6-86cb-39aa9bb30dad req-54d1cc3c-4200-469f-8a56-a18c54e6b5fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033376 May 09 18:34:45.338219 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 305/603] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 09 18:34:45.349128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:45.356835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9abed394-b016-4443-bb00-07fffd3293c5 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.190761 May 09 18:34:45.357493 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 299/604] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:45 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:45.420741 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:45.421369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:45.428244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:45.428705 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:45.429487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:45.429959 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:45.558805 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:45.566015 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7ee2f79d-22a0-4334-b3ea-40e3c0979a58 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1518 microversion: 2.1 time: 0.149209 May 09 18:34:45.566582 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 306/605] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:45 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:46.431885 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:46.432517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:46.438380 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.438840 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.439640 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.440083 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.569969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:46.577422 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-39a66d02-56f8-4180-895a-300c135bd50f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.205983 May 09 18:34:46.577792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 300/606] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:46 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:46.582990 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:46.583643 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:46.589995 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.590548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.591366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.591814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.723596 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:46.730958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-db4a3565-79ba-42fc-afc7-fbd02d398aa1 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.152403 May 09 18:34:46.731557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 307/607] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:46 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:46.837958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:46.838474 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:46.844420 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.844920 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.845711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.846166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.870783 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:34:46.942024 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-747f3fa1-1369-4b61-9e50-cc2ecd9308ed tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 204 len: 0 microversion: 2.1 time: 0.107138 May 09 18:34:46.942598 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 301/608] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:34:46 2022] DELETE /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:34:46.950706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:46.951373 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:46.957681 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.958148 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:46.958940 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:46.959423 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.087653 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:47.094982 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f7fb1a18-162b-4dd7-bf00-b08a87434b6d tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1508 microversion: 2.1 time: 0.148193 May 09 18:34:47.095595 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 308/609] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:46 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:47.353595 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-8dcbccd4-21c8-4543-9ab5-91b1ea7c7baf req-aa23b856-7c7f-4249-805e-816160d58904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95113e2-f278-45ae-afa3-7d1bee1e08a1", "name": "network-vif-plugged", "status": "completed", "tag": "6565f8c1-96d5-4ffe-82fd-eba43170e663"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:47.361636 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8dcbccd4-21c8-4543-9ab5-91b1ea7c7baf req-aa23b856-7c7f-4249-805e-816160d58904 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.362081 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8dcbccd4-21c8-4543-9ab5-91b1ea7c7baf req-aa23b856-7c7f-4249-805e-816160d58904 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.373326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-8dcbccd4-21c8-4543-9ab5-91b1ea7c7baf req-aa23b856-7c7f-4249-805e-816160d58904 service nova] Creating event network-vif-plugged:6565f8c1-96d5-4ffe-82fd-eba43170e663 for instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 on hv-cinder-84112 May 09 18:34:47.378164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-8dcbccd4-21c8-4543-9ab5-91b1ea7c7baf req-aa23b856-7c7f-4249-805e-816160d58904 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028469 May 09 18:34:47.379559 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 302/610] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:34:47.595692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:47.596257 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:47.603538 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.604008 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.604795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.605245 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.732277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:47.740107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1df407b0-7f21-4f25-927d-ee44d31834bd tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.149504 May 09 18:34:47.740671 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 309/611] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:47 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:47.748435 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:47.749151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:47.755584 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.756047 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.756819 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.757271 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.864553 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f0faa5bc-6513-48fe-93a2-582f63ba19a5 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:47.865569 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f0faa5bc-6513-48fe-93a2-582f63ba19a5 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:47.871420 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0faa5bc-6513-48fe-93a2-582f63ba19a5 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.871889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0faa5bc-6513-48fe-93a2-582f63ba19a5 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.872676 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0faa5bc-6513-48fe-93a2-582f63ba19a5 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.873393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0faa5bc-6513-48fe-93a2-582f63ba19a5 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.897050 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:47.901657 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f0faa5bc-6513-48fe-93a2-582f63ba19a5 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041060 May 09 18:34:47.902227 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 310/612] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:34:47 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 09 18:34:47.904487 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f89ace2f-91ab-407b-985e-9ab20f9a7a5f tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.160447 May 09 18:34:47.905211 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 303/613] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:47 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:47.957957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:47.958635 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:47.964487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.964946 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.965728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:47.966169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:47.991236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:34:48.064289 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ba3a9560-feda-4cc5-8a1b-672c236b7ab7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 204 len: 0 microversion: 2.1 time: 0.110606 May 09 18:34:48.064857 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 311/614] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:34:47 2022] DELETE /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:34:48.072841 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:48.073466 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:48.079303 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.079759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.080537 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.080987 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.111741 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:48.112565 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:48.118456 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.118984 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.119816 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.120261 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.259801 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:48.267018 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-30dccc89-0d1a-467d-a9e9-6d3ab0e37326 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1674 microversion: 2.1 time: 0.197972 May 09 18:34:48.267613 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 304/615] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:48 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:48.282562 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:48.289746 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6995180e-c5d5-4c89-8866-a59ceb9c89ea tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1508 microversion: 2.1 time: 0.182272 May 09 18:34:48.290304 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 312/616] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:48 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:48.756954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:48.757573 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:48.763798 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.764255 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.765021 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.765460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.893858 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:48.901018 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d67248c0-756c-49a5-92a8-f351ce2a77f1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.148562 May 09 18:34:48.901579 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 305/617] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:48 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:48.921580 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:48.922205 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:48.928529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.928991 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:48.929765 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:48.930209 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.058248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:49.065550 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f4b1ac55-6a3a-46fa-ab0a-e11748a6b3fb tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.147763 May 09 18:34:49.066116 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 313/618] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:48 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:49.285529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:49.286069 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:49.291927 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.292384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.293149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.293591 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.306219 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:49.306845 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:49.312653 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.313110 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.313887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.314331 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.491108 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:49.497646 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:49.498902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-51153a12-f28e-4c5d-90fc-2e832c61779d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1674 microversion: 2.1 time: 0.217838 May 09 18:34:49.499519 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 306/619] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:49 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:49.505137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c586ef68-eeae-43f5-907c-e6d9df486fa1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1508 microversion: 2.1 time: 0.202772 May 09 18:34:49.505692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 314/620] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:49 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:49.917708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:49.918337 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:49.924813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.925358 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:49.926171 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:49.926638 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.051446 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:50.058557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0d101c47-af20-4429-88ea-b9a8ecf487b3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.144710 May 09 18:34:50.059119 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 307/621] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:49 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:50.082208 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:50.083216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:50.089637 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.090098 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.090877 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.091348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.218224 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:50.225605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f822f2bd-de3d-42e1-8e03-87e66b338f0a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.147772 May 09 18:34:50.226194 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 315/622] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:50 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:50.516317 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:50.516940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:50.522843 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:50.522984 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.523421 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.523561 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:50.524198 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.524647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.529216 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.529683 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.530462 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:50.530911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:50.716455 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:50.720402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:50.724137 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-831e58c7-2d31-4da8-b28e-6bba8e045992 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1674 microversion: 2.1 time: 0.211646 May 09 18:34:50.724719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 308/623] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:50 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:50.727893 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2d2f8b92-3446-4de1-80a8-03bd4a2ac24b tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1508 microversion: 2.1 time: 0.208685 May 09 18:34:50.728458 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 316/624] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:50 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:51.075858 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:51.076476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:51.082605 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.083061 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.083866 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.084309 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.216722 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:51.224694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-49dcb51b-c6d6-48d7-9eff-e8065eac889f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.152632 May 09 18:34:51.225272 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 309/625] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:51 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:51.242306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:51.242964 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:51.249468 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.249929 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.250701 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.251143 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.376770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:51.384377 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8e35dfff-e98c-4c41-a977-b99c24cdc81d tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.146600 May 09 18:34:51.385092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 317/626] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:51 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:51.741617 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:51.742822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:51.748119 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:51.748753 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:51.750927 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.751663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.752663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.753598 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.755798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.756281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.757259 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.757935 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.891501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:51.900726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2941d777-50e4-4c97-b7b7-cc5bac479455 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1466 microversion: 2.1 time: 0.159258 May 09 18:34:51.910241 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 318/627] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:51 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:51.916407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-5939af6b-29b6-42fd-9aad-edd06dcf33c5 req-a2d02274-2bb1-48fb-ac9a-bdf860c6fe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f754ac61-c5df-4016-abe2-d0c01e946f0d", "name": "network-vif-deleted", "tag": "4449e893-fb12-4e63-acd4-0431cb2533e9"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:51.924729 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5939af6b-29b6-42fd-9aad-edd06dcf33c5 req-a2d02274-2bb1-48fb-ac9a-bdf860c6fe5f service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:51.926021 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5939af6b-29b6-42fd-9aad-edd06dcf33c5 req-a2d02274-2bb1-48fb-ac9a-bdf860c6fe5f service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:51.938519 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-5939af6b-29b6-42fd-9aad-edd06dcf33c5 req-a2d02274-2bb1-48fb-ac9a-bdf860c6fe5f service nova] Creating event network-vif-deleted:4449e893-fb12-4e63-acd4-0431cb2533e9 for instance f754ac61-c5df-4016-abe2-d0c01e946f0d on hv-cinder-84112 May 09 18:34:51.944570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-5939af6b-29b6-42fd-9aad-edd06dcf33c5 req-a2d02274-2bb1-48fb-ac9a-bdf860c6fe5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032699 May 09 18:34:51.945753 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 319/628] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:52.041453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:52.048732 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f42a6169-8d5a-4325-b9da-8689190f1c4a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1674 microversion: 2.1 time: 0.311403 May 09 18:34:52.049397 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 310/629] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:51 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1674 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:52.241459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:52.242617 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:52.249826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.250293 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.251194 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.251680 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.401822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:52.402695 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:52.409991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.410382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.411201 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.411647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.462483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:52.470104 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5f0f088e-94a3-449c-9b96-0c697a260ea4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1366 microversion: 2.1 time: 0.232858 May 09 18:34:52.470919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 320/630] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:52 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:52.635960 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:52.645744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b5f54ea3-2ae8-47bd-8d46-db2b36082d8a tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.248062 May 09 18:34:52.655566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 311/631] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:52 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:52.835577 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-aa99605b-674b-4d71-a999-c901bbaf32d8 req-67bb75c0-4eb4-4828-ba93-fc0e7b075f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a805d4-1420-4adb-a173-724abc1e9915", "name": "network-vif-deleted", "tag": "1e18cb42-6fa5-49f6-8510-1b14aaa7fef4"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:52.844543 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-aa99605b-674b-4d71-a999-c901bbaf32d8 req-67bb75c0-4eb4-4828-ba93-fc0e7b075f61 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.845360 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-aa99605b-674b-4d71-a999-c901bbaf32d8 req-67bb75c0-4eb4-4828-ba93-fc0e7b075f61 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.857969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-aa99605b-674b-4d71-a999-c901bbaf32d8 req-67bb75c0-4eb4-4828-ba93-fc0e7b075f61 service nova] Creating event network-vif-deleted:1e18cb42-6fa5-49f6-8510-1b14aaa7fef4 for instance a7a805d4-1420-4adb-a173-724abc1e9915 on hv-cinder-84112 May 09 18:34:52.864119 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-aa99605b-674b-4d71-a999-c901bbaf32d8 req-67bb75c0-4eb4-4828-ba93-fc0e7b075f61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032285 May 09 18:34:52.865365 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 321/632] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:52.917657 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:52.918372 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:52.924879 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.926238 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.927327 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.928057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.974076 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:52.974544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:52.975016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lazy-loading 'fault' on Instance uuid f754ac61-c5df-4016-abe2-d0c01e946f0d {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:34:53.020071 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:53.028216 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1326b60d-a576-4c21-b068-952772521e24 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 200 len: 1312 microversion: 2.1 time: 0.113810 May 09 18:34:53.028810 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 312/633] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:52 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:53.066514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:53.067143 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:53.073210 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.073716 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.074544 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.074993 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.146963 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:53.154477 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f8685b76-79a5-4a00-8b1d-d2afc5284b65 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 200 len: 1606 microversion: 2.1 time: 0.092246 May 09 18:34:53.155393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 322/634] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:53 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:53.486986 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:53.487684 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:53.493788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.494244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.495013 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.495555 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.623845 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:53.631973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4b02f6f8-f7e6-41b5-8ed7-d74b61547d89 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1557 microversion: 2.1 time: 0.148530 May 09 18:34:53.632556 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 313/635] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:53 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:53.648713 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-98e99ac2-6603-4e7e-a541-d5048b7ee02f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:53.649233 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-98e99ac2-6603-4e7e-a541-d5048b7ee02f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:53.656006 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98e99ac2-6603-4e7e-a541-d5048b7ee02f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.656468 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98e99ac2-6603-4e7e-a541-d5048b7ee02f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.657459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98e99ac2-6603-4e7e-a541-d5048b7ee02f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.658106 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98e99ac2-6603-4e7e-a541-d5048b7ee02f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.661888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:53.662734 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:53.668761 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.669223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.670010 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:53.670452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:53.771948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-98e99ac2-6603-4e7e-a541-d5048b7ee02f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124841 May 09 18:34:53.771948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 323/636] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:34:53 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:53.867453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:53.876540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f2755637-83dd-4729-aa0a-89af97ff2fe7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.218563 May 09 18:34:53.877125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 314/637] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:53 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:54.045172 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:54.045797 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: f754ac61-c5df-4016-abe2-d0c01e946f0d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:54.052434 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.052994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.053790 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.054244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.070072 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] HTTP exception thrown: Instance f754ac61-c5df-4016-abe2-d0c01e946f0d could not be found. May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Request method failure captured: May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d HTTP/1.1 May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2kHVKHC70jbdtlqcLtqCx7g8VL5Ug9a38m55Hd4sd7xI_aKp02cfltlH8kw6KHcPBWVNk_QCErJ0e4HWOjTcdH2NE1e3exEo9xfCwZYUBGt44Ky1nFiqcOLtH0XYYWol2eIWyOxRXndYcydWBN4_V5euBVPzJagYjI7UZEWWpXOsM May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:34:54.071774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_705eecf37fcc4fe7aabef923ece6ad59"}]}] May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: acae3ad19a7e45b9877520dff8f5b995 May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance f754ac61-c5df-4016-abe2-d0c01e946f0d could not be found. May 09 18:34:54.073105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'f754ac61-c5df-4016-abe2-d0c01e946f0d'} May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f754ac61-c5df-4016-abe2-d0c01e946f0d could not be found. May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:34:54.073856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f754ac61-c5df-4016-abe2-d0c01e946f0d could not be found. May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f754ac61-c5df-4016-abe2-d0c01e946f0d could not be found. May 09 18:34:54.075139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.076242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Returning 404 to user: Instance f754ac61-c5df-4016-abe2-d0c01e946f0d could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:34:54.076242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c4f8f69f-91b0-4f1b-81f0-605959f034a7 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d" status: 404 len: 111 microversion: 2.1 time: 0.032045 May 09 18:34:54.076242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 324/638] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:54 2022] GET /compute/v2.1/servers/f754ac61-c5df-4016-abe2-d0c01e946f0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:34:54.081914 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:54.082431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:54.088438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.088900 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.089685 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.090134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.116788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:34:54.234303 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a05b9d38-9a1e-471b-a1c2-383c9b468512 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 204 len: 0 microversion: 2.1 time: 0.155560 May 09 18:34:54.238557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 315/639] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:34:54 2022] DELETE /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:34:54.245330 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:54.246119 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:54.252912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.253327 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.254305 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.254775 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.306444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:54.307015 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:54.313021 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.313485 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.314466 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.315096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.329618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] HTTP exception thrown: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Request method failure captured: May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 HTTP/1.1 May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2gsEqVj7Qu4noNTft0UonuomMv88J41HEMVPVdnUH3VHbHyh3I4N3c5XDRnRlPQ7OWqxBb-lkfXXQlQ1lRnXG7OxzBp31fSrKcXjDTu6PqCPCi32vcEL36s8DJPeI5XQGaNNjsNKd9LuWZ3ayFuCcGlTnSPxppe8H5hqyyqJuXeqs May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:34:54.331246 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78039fb4f0bd454b8aea3db748343263"}]}] May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeTestJSON-1762280653 May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 90fdc96d6e6649a498bb3a8659fcc030 May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:34:54.332599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'a7a805d4-1420-4adb-a173-724abc1e9915'} May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:34:54.333400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:34:54.334594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:34:54.335769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Returning 404 to user: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:34:54.335769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6c7888d0-c0a8-4daf-b1d3-f5ad781ef973 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 404 len: 111 microversion: 2.1 time: 0.164458 May 09 18:34:54.335769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 325/640] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:54 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 18:34:54.341351 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-39c613bb-f135-4050-b1c1-b69df170d390 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '.version_select at 0x7f3f7e754c10>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:54.362541 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-39c613bb-f135-4050-b1c1-b69df170d390 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224619962" status: 202 len: 0 microversion: 2.1 time: 0.024628 May 09 18:34:54.363706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 326/641] 10.222.0.25 () {58 vars in 1220 bytes} [Mon May 9 18:34:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224619962 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:34:54.394635 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:54.402520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b3b3431b-4fb1-426e-ae23-825a91e0c57a tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.161509 May 09 18:34:54.403106 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 316/642] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:54 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:54.885441 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-73c060dd-079c-49be-960c-b1ecb169ae36 req-f8559c9b-19c5-4518-b3cc-91788d0f50a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a95113e2-f278-45ae-afa3-7d1bee1e08a1", "tag": "6565f8c1-96d5-4ffe-82fd-eba43170e663"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:54.896413 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-73c060dd-079c-49be-960c-b1ecb169ae36 req-f8559c9b-19c5-4518-b3cc-91788d0f50a8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.897253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:54.897883 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-73c060dd-079c-49be-960c-b1ecb169ae36 req-f8559c9b-19c5-4518-b3cc-91788d0f50a8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.897998 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:54.906460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.907566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.908494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:54.910095 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:54.910481 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-73c060dd-079c-49be-960c-b1ecb169ae36 req-f8559c9b-19c5-4518-b3cc-91788d0f50a8 service nova] Creating event network-changed:6565f8c1-96d5-4ffe-82fd-eba43170e663 for instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 on hv-cinder-84112 May 09 18:34:54.915799 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-73c060dd-079c-49be-960c-b1ecb169ae36 req-f8559c9b-19c5-4518-b3cc-91788d0f50a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 May 09 18:34:54.916671 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 327/643] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:55.095059 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:55.103718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2860487e-b2ac-4806-b821-57cbf8ff1955 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.212817 May 09 18:34:55.109304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 317/644] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:54 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:55.229108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c31f5485-c1e2-4e5a-8304-25287458f5e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'create', calling method: .version_select at 0x7f3f7e7119d0>, body: {"keypair": {"name": "tempest-keypair-1385940186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkpDIg41M4mGYO3Z0/QjTm0kF8ECfn7/T8ns50BSh2OzCRQPNFypFIqXvFVE/lDIAfcLmAqTS53SkBvTWyIza9Dhtn9KRGs6SMOuvY3Z1PxII16EwUG5cf6qRz9Mq92Bg=="}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:55.243564 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-c31f5485-c1e2-4e5a-8304-25287458f5e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for project 78039fb4f0bd454b8aea3db748343263. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:55.247911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-c31f5485-c1e2-4e5a-8304-25287458f5e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for user 90fdc96d6e6649a498bb3a8659fcc030 and project 78039fb4f0bd454b8aea3db748343263. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:55.271634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c31f5485-c1e2-4e5a-8304-25287458f5e8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046747 May 09 18:34:55.272245 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 328/645] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:34:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:55.420226 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:55.420850 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:55.427698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:55.428111 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:55.428973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:55.429428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:55.610762 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:55.619024 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8ce72b7b-16f3-4f88-9862-88af098ceec4 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.202662 May 09 18:34:55.629357 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 318/646] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:55 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:56.122455 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:56.124563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:56.132507 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:56.132974 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:56.133780 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:56.134230 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:56.270355 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:56.277901 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ca98df4a-385f-46c9-b43d-0257141ebdab tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.161829 May 09 18:34:56.278596 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 329/647] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:56 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:56.553289 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-704104744", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4730889d-2bd2-49e5-82ef-67b5eb3e8023"}], "security_groups": [{"name": "tempest-securitygroup--218327182"}], "key_name": "tempest-keypair-1385940186", "user_data": "}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:56.636111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:56.636737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:56.642853 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:56.643361 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:56.644144 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:56.644588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:56.650965 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] validate_networks() for [('4730889d-2bd2-49e5-82ef-67b5eb3e8023', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:34:56.847567 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:56.855011 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4716f416-942d-4969-91cb-8514b5fa4d94 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.222938 May 09 18:34:56.855840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 330/648] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:56 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:34:57.079319 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:34:57.079753 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:34:57.080243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:34:57.080668 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:34:57.081605 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:34:57.090162 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:57.090644 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:57.091491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:57.091956 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:57.108486 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for project 78039fb4f0bd454b8aea3db748343263. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:34:57.112511 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Getting quotas for user 90fdc96d6e6649a498bb3a8659fcc030 and project 78039fb4f0bd454b8aea3db748343263. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:34:57.123191 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:34:57.125441 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:34:57.170380 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fa43e454-0fcf-4946-993c-35cdd74253f7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.622008 May 09 18:34:57.171214 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 319/649] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:34:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:34:57.181156 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-da960785-d4a2-443f-88b3-ff12cedebb5a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:57.181777 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-da960785-d4a2-443f-88b3-ff12cedebb5a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:57.242283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-da960785-d4a2-443f-88b3-ff12cedebb5a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:57.249539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-da960785-d4a2-443f-88b3-ff12cedebb5a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1237 microversion: 2.1 time: 0.072319 May 09 18:34:57.250103 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 331/650] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:57 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:57.295608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:57.296497 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:57.302388 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:57.302853 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:57.303854 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:57.304306 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:57.483441 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:57.496353 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-476b0f57-f048-4ec2-aef0-bb8b0f6b92e8 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.205041 May 09 18:34:57.497018 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 320/651] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:57 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:57.871981 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:57.872859 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:57.880384 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:57.880849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:57.881637 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:57.882085 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:58.060059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:58.067486 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4c895a79-2120-464e-9525-791d527a58fc tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1522 microversion: 2.1 time: 0.199387 May 09 18:34:58.068072 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 332/652] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:57 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:58.266508 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:58.267134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:58.273473 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:58.273943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:58.274728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:58.275203 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:58.349643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:58.356904 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1a3dfd26-c56b-46b4-b8f2-b3ec103a1142 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1289 microversion: 2.1 time: 0.094268 May 09 18:34:58.357601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 321/653] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:58 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:58.513881 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:58.514591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:58.521662 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:58.522128 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:58.522926 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:58.523418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.086612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:59.091823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:59.092740 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:59.102699 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c8f0fb11-4c79-4155-9c69-140d4290b9d0 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.592721 May 09 18:34:59.108605 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 333/654] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:58 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:59.109252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:59.109946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.110931 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:59.111572 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.153010 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-7424534c-cbaf-4505-a3f4-d642c8feaba0 req-0459ae0a-be09-4d1e-a7ce-69b38c296a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e67e009-eec8-48f1-b8ec-5ba755aeba51", "name": "network-vif-deleted", "tag": "28dc9b59-8a04-48ce-a5d0-8f7894d1dc83"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:34:59.191968 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7424534c-cbaf-4505-a3f4-d642c8feaba0 req-0459ae0a-be09-4d1e-a7ce-69b38c296a47 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:59.194405 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acae3ad19a7e45b9877520dff8f5b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705eecf37fcc4fe7aabef923ece6ad59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:59.196211 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7424534c-cbaf-4505-a3f4-d642c8feaba0 req-0459ae0a-be09-4d1e-a7ce-69b38c296a47 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.205983 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3b3ec835-a65e-467a-9433-ae7670e5053c tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 200 len: 1480 microversion: 2.1 time: 0.124486 May 09 18:34:59.206908 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 322/655] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:59 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 1480 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:34:59.210144 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-7424534c-cbaf-4505-a3f4-d642c8feaba0 req-0459ae0a-be09-4d1e-a7ce-69b38c296a47 service nova] Creating event network-vif-deleted:28dc9b59-8a04-48ce-a5d0-8f7894d1dc83 for instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 on hv-cinder-84112 May 09 18:34:59.216838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-7424534c-cbaf-4505-a3f4-d642c8feaba0 req-0459ae0a-be09-4d1e-a7ce-69b38c296a47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076123 May 09 18:34:59.217869 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 334/656] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:34:59.374255 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:34:59.374950 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:34:59.382054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:59.382519 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.383350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:34:59.384202 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:34:59.538951 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:34:59.546488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0db5e850-1766-457e-879a-ee57316c30af tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1362 microversion: 2.1 time: 0.176496 May 09 18:34:59.557380 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 323/657] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:34:59 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:00.126371 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:00.127727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:00.133620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.134105 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.134883 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.135357 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.222905 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:00.223814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] [instance: 5e67e009-eec8-48f1-b8ec-5ba755aeba51] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:00.229713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.230180 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.230969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.231454 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.247375 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] HTTP exception thrown: Instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 could not be found. May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Request method failure captured: May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 HTTP/1.1 May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2kHVKHC70jbdtlqcLtqCx7g8VL5Ug9a38m55Hd4sd7xI_aKp02cfltlH8kw6KHcPBWVNk_QCErJ0e4HWOjTcdH2NE1e3exEo9xfCwZYUBGt44Ky1nFiqcOLtH0XYYWol2eIWyOxRXndYcydWBN4_V5euBVPzJagYjI7UZEWWpXOsM May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:35:00.249312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/705eecf37fcc4fe7aabef923ece6ad59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_705eecf37fcc4fe7aabef923ece6ad59"}]}] May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 705eecf37fcc4fe7aabef923ece6ad59 May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1515772222 May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: acae3ad19a7e45b9877520dff8f5b995 May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1515772222-project May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 could not be found. May 09 18:35:00.250789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '5e67e009-eec8-48f1-b8ec-5ba755aeba51'} May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 could not be found. May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:35:00.251525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 could not be found. May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 could not be found. May 09 18:35:00.252718 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:35:00.255028 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] Returning 404 to user: Instance 5e67e009-eec8-48f1-b8ec-5ba755aeba51 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:35:00.255028 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4592d035-25b9-4265-8b95-88c009ab05e1 tempest-ServerRescueNegativeTestJSON-1515772222 tempest-ServerRescueNegativeTestJSON-1515772222-project] 10.222.0.25 "GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51" status: 404 len: 111 microversion: 2.1 time: 0.031850 May 09 18:35:00.256663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 324/658] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:00 2022] GET /compute/v2.1/servers/5e67e009-eec8-48f1-b8ec-5ba755aeba51 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:35:00.288959 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:00.297075 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1ac31add-582a-43de-b664-4fb1d95e1264 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.175692 May 09 18:35:00.297821 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 335/659] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:00 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:00.564276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:00.565004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:00.574241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.575025 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.576011 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.576599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.588909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-6440c71c-ae3e-4bfb-a3e5-f2d0fac8cb4f req-41c2ed84-8a61-4112-a6a5-4c603ae240b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff614ce6-f3fe-49aa-97f6-a7c309da1953", "tag": "4cb5792d-607a-471d-b6dd-c779ad1dc8a6"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:00.604634 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6440c71c-ae3e-4bfb-a3e5-f2d0fac8cb4f req-41c2ed84-8a61-4112-a6a5-4c603ae240b5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:00.605092 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6440c71c-ae3e-4bfb-a3e5-f2d0fac8cb4f req-41c2ed84-8a61-4112-a6a5-4c603ae240b5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:00.623053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-6440c71c-ae3e-4bfb-a3e5-f2d0fac8cb4f req-41c2ed84-8a61-4112-a6a5-4c603ae240b5 service nova] Creating event network-changed:4cb5792d-607a-471d-b6dd-c779ad1dc8a6 for instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 on hv-cinder-84112 May 09 18:35:00.634354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-6440c71c-ae3e-4bfb-a3e5-f2d0fac8cb4f req-41c2ed84-8a61-4112-a6a5-4c603ae240b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049887 May 09 18:35:00.635566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 336/660] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:00.746033 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:00.756398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-51349a3a-2a00-4e6b-b61e-a4f15c5a3d29 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1362 microversion: 2.1 time: 0.195720 May 09 18:35:00.756874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 325/661] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:00 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:01.151846 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-b718afa1-1f5b-4116-8c12-a5a28b2fec27 req-c8ba86c5-418a-4f8c-a973-fa388e6e6299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8243cbea-6bde-4ac9-8f5a-53ec888ed813", "name": "network-vif-plugged", "status": "completed", "tag": "c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:01.161608 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b718afa1-1f5b-4116-8c12-a5a28b2fec27 req-c8ba86c5-418a-4f8c-a973-fa388e6e6299 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:01.162158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b718afa1-1f5b-4116-8c12-a5a28b2fec27 req-c8ba86c5-418a-4f8c-a973-fa388e6e6299 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:01.179614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-b718afa1-1f5b-4116-8c12-a5a28b2fec27 req-c8ba86c5-418a-4f8c-a973-fa388e6e6299 service nova] Creating event network-vif-plugged:c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c for instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 on hv-cinder-84112 May 09 18:35:01.185288 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-b718afa1-1f5b-4116-8c12-a5a28b2fec27 req-c8ba86c5-418a-4f8c-a973-fa388e6e6299 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037542 May 09 18:35:01.186017 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 337/662] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:01.315151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:01.316232 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:01.322365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:01.322821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:01.323807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:01.324520 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:01.470240 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:01.478612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9c9bbfd8-4a09-4b49-abae-82d573b9ad38 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.168202 May 09 18:35:01.479887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 326/663] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:01 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:01.774366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:01.775090 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:01.781262 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:01.781730 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:01.783020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:01.783737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:01.930694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:01.941055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6e35d224-5e64-482a-8446-71cd941ebeb3 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1362 microversion: 2.1 time: 0.170477 May 09 18:35:01.942024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 338/664] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:01 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:02.496743 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:02.498296 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:02.505864 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:02.506328 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:02.507353 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:02.507968 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:02.704433 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:02.712694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c50448e4-47f1-4ab4-a7a8-4be48f87e206 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1574 microversion: 2.1 time: 0.219774 May 09 18:35:02.723456 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 327/665] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:02 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:02.957926 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:02.958708 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:02.965356 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:02.965881 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:02.966904 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:02.967439 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:03.242404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:03.251278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d59a0c6e-0ee5-46c1-aeb4-0386fa73cf97 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1362 microversion: 2.1 time: 0.297255 May 09 18:35:03.256161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 339/666] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:02 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:03.729827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:03.731088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:03.738936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:03.739447 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:03.740494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:03.740948 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:03.993972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:04.002220 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-975d4ed9-ce6f-4a25-ab46-1de5373176b7 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1561 microversion: 2.1 time: 0.276156 May 09 18:35:04.006176 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 328/667] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:03 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1561 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:04.268597 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:04.269219 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:04.276384 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.278283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.279533 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:04.280001 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:04.418822 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:04.426257 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-70f9af02-27e3-4a4c-bbfa-47e6e423ac2a tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1362 microversion: 2.1 time: 0.161935 May 09 18:35:04.426926 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 340/668] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:04 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:05.166276 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-dec137e1-3f97-40b1-9b77-aa97b82234e4 req-12d4fac4-2394-4da2-8c42-78fb238a29af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff614ce6-f3fe-49aa-97f6-a7c309da1953", "name": "network-vif-plugged", "status": "completed", "tag": "4cb5792d-607a-471d-b6dd-c779ad1dc8a6"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:05.177700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-dec137e1-3f97-40b1-9b77-aa97b82234e4 req-12d4fac4-2394-4da2-8c42-78fb238a29af service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:05.178473 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-dec137e1-3f97-40b1-9b77-aa97b82234e4 req-12d4fac4-2394-4da2-8c42-78fb238a29af service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:05.189666 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-dec137e1-3f97-40b1-9b77-aa97b82234e4 req-12d4fac4-2394-4da2-8c42-78fb238a29af service nova] Creating event network-vif-plugged:4cb5792d-607a-471d-b6dd-c779ad1dc8a6 for instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 on hv-cinder-84112 May 09 18:35:05.195170 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-dec137e1-3f97-40b1-9b77-aa97b82234e4 req-12d4fac4-2394-4da2-8c42-78fb238a29af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034220 May 09 18:35:05.195868 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 329/669] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:05.443366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:05.444938 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:05.451144 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:05.451679 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:05.452465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:05.452906 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:05.588433 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:05.595591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-596031b9-5561-4ae9-9a23-7f6fd340ede4 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1362 microversion: 2.1 time: 0.156320 May 09 18:35:05.596091 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 341/670] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:05 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:06.614363 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:06.614991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:06.621008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:06.621468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:06.622240 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:06.622941 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:06.746074 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:06.754130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c34e3e66-e40f-42d6-bb60-d0d8949e32d8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1362 microversion: 2.1 time: 0.145091 May 09 18:35:06.754700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 330/671] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:06 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:07.771257 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:07.771890 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:07.778266 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.778731 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:07.779558 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.780007 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:07.907767 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:07.914948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-00869f0a-1672-46ed-bbc2-9c9163e9ae08 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1548 microversion: 2.1 time: 0.148159 May 09 18:35:07.915540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 342/672] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:07 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:07.930807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d288a051-ddb6-488d-a425-2957d7f6a40e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:07.931350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d288a051-ddb6-488d-a425-2957d7f6a40e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:07.937532 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d288a051-ddb6-488d-a425-2957d7f6a40e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.937994 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d288a051-ddb6-488d-a425-2957d7f6a40e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:07.938760 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d288a051-ddb6-488d-a425-2957d7f6a40e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:07.939223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d288a051-ddb6-488d-a425-2957d7f6a40e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:08.016489 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d288a051-ddb6-488d-a425-2957d7f6a40e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089429 May 09 18:35:08.017121 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 331/673] 10.222.0.25 () {58 vars in 1274 bytes} [Mon May 9 18:35:07 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:09.307096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-faac118f-defd-40e2-992a-f67a6597c14c req-14cf55b4-dfe7-40bb-9382-b8b2154b098e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff614ce6-f3fe-49aa-97f6-a7c309da1953", "tag": "4cb5792d-607a-471d-b6dd-c779ad1dc8a6"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:09.314838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-faac118f-defd-40e2-992a-f67a6597c14c req-14cf55b4-dfe7-40bb-9382-b8b2154b098e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:09.315333 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-faac118f-defd-40e2-992a-f67a6597c14c req-14cf55b4-dfe7-40bb-9382-b8b2154b098e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:09.325771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-faac118f-defd-40e2-992a-f67a6597c14c req-14cf55b4-dfe7-40bb-9382-b8b2154b098e service nova] Creating event network-changed:4cb5792d-607a-471d-b6dd-c779ad1dc8a6 for instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 on hv-cinder-84112 May 09 18:35:09.330553 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-faac118f-defd-40e2-992a-f67a6597c14c req-14cf55b4-dfe7-40bb-9382-b8b2154b098e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142369 May 09 18:35:09.331211 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 343/674] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:11.183346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ed7439c4-ae69-45ca-9c51-d70abf3a2c3d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:11.183852 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ed7439c4-ae69-45ca-9c51-d70abf3a2c3d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:11.190867 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7439c4-ae69-45ca-9c51-d70abf3a2c3d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.191593 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7439c4-ae69-45ca-9c51-d70abf3a2c3d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.192460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7439c4-ae69-45ca-9c51-d70abf3a2c3d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:11.192926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7439c4-ae69-45ca-9c51-d70abf3a2c3d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:11.218996 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ed7439c4-ae69-45ca-9c51-d70abf3a2c3d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/ips" status: 200 len: 151 microversion: 2.20 time: 0.040715 May 09 18:35:11.219733 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 332/675] 10.222.0.25 () {60 vars in 1288 bytes} [Mon May 9 18:35:11 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:35:13.155446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:13.155960 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:13.162493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.162948 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.163738 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.164180 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.186372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lazy-loading 'flavor' on Instance uuid edd17ee8-9df4-4b0b-b150-574fed351dde {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:35:13.449972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-79d05669-47a9-416e-ad3d-8f3d697b4e36 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/action" status: 202 len: 0 microversion: 2.20 time: 0.299016 May 09 18:35:13.450728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 344/676] 10.222.0.25 () {62 vars in 1318 bytes} [Mon May 9 18:35:13 2022] POST /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 09 18:35:13.459460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:13.460088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:13.466954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.467673 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.468725 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:13.469323 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:13.603065 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:13.617752 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:13.619320 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:13.620507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6efd533d-2cfe-4586-99bd-3c3496f89dae tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.165476 May 09 18:35:13.621080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 333/677] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:13 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:14.639692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:14.640398 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:14.646648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.647340 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.648292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:14.648928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:14.784352 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:14.792688 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:14.794202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:14.795390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c5ced908-775c-4114-9207-29c4493d41dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.160406 May 09 18:35:14.795936 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 345/678] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:14 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:35:15.815275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:15.815909 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:15.825389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:15.825389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:15.825389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:15.825389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:15.958646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:15.967203 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:15.968890 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:15.970059 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ea986867-e5a5-4bc8-bbfd-87dadc65e1c2 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.159249 May 09 18:35:15.971312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 334/679] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:15 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:16.989207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:16.990352 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:16.997156 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:16.997876 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:16.998649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:16.999090 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:17.134786 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:17.144408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:17.146162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:17.147480 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-24896ba1-bf43-473b-a7b9-2fa4366de013 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.162710 May 09 18:35:17.148114 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 346/680] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:16 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:18.165845 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:18.166476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:18.173268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:18.173729 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:18.175015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:18.175739 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:18.306589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:18.314407 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:18.316012 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:18.317207 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0235fc7d-96b2-47e4-8896-2b1fe4a18719 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.155257 May 09 18:35:18.317763 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 335/681] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:18 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:19.335661 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:19.336281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:19.342612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:19.343078 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:19.343894 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:19.344372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:19.473096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:19.480767 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:19.482301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:19.483485 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2227f6f0-469c-45c5-bc0f-1b60b23ae1b5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.151868 May 09 18:35:19.484048 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 347/682] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:19 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:20.502174 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:20.502802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:20.509091 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:20.509555 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:20.510328 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:20.510778 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:20.640617 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:20.648808 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:20.650728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:20.652057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f05bfb58-75e5-4535-b35e-9ee602bc5ba8 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.153875 May 09 18:35:20.652664 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 336/683] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:20 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:21.670627 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:21.671666 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:21.678523 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:21.678985 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:21.679797 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:21.680249 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:21.806292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:21.813918 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:21.816149 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:21.817306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9bb553a2-1b0e-473a-b9f7-7618bf789dde tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.150694 May 09 18:35:21.817869 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 348/684] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:21 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:22.835029 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:22.836200 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:22.846241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:22.846711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:22.847547 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:22.847997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:22.984322 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:22.992234 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:22.993784 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:22.994940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8d76059e-5e9f-4cd7-a7a9-04180aea7f4e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.163896 May 09 18:35:22.995557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 337/685] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:22 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:24.013701 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:24.014326 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:24.021251 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:24.021713 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:24.022509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:24.022955 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:24.152601 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:24.162003 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:24.163557 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:24.165048 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-233bfe33-8385-4d86-9d87-fbe96b86e44d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.155219 May 09 18:35:24.165822 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 349/686] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:24 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:25.184016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:25.184670 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:25.190954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:25.191450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:25.192225 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:25.192675 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:25.321061 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:25.329120 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:25.330693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:25.332414 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-54bd4145-9c70-464b-adb5-9aeaf443f084 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.152474 May 09 18:35:25.332983 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 338/687] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:25 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:26.349775 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:26.350408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:26.356989 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:26.357456 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:26.358244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:26.358714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:26.488898 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:26.502878 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:26.505229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:26.506446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f1b012f3-6974-44e0-b683-daa6ceefbf23 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.160612 May 09 18:35:26.507031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 350/688] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:26 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:27.525219 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:27.525880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:27.532175 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:27.532643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:27.533425 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:27.533880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:27.662215 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:27.669986 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:27.671524 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:27.672674 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-094b5239-435d-44c1-be7c-89503f0c69d1 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.151407 May 09 18:35:27.673239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 339/689] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:27 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:28.693826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:28.694482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:28.700840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:28.701306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:28.702080 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:28.702526 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:28.832838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:28.840849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:28.843030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:28.843789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3c4fa719-64ac-489d-a5ae-7e6ffb5d1687 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.154384 May 09 18:35:28.844366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 351/690] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:28 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:29.861807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:29.862426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:29.869552 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:29.870062 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:29.870867 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:29.871368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:30.002182 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:30.011400 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:30.012915 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:30.014085 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-28290a82-db14-4624-919d-ad150b116425 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1743 microversion: 2.20 time: 0.156212 May 09 18:35:30.014652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 340/691] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:29 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:31.032989 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:31.033612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:31.039982 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:31.040448 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:31.041228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:31.041677 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:31.177547 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:31.185657 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:31.187319 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:31.188569 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b81d159b-3298-481e-aa95-10be2cad8501 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1743 microversion: 2.20 time: 0.159480 May 09 18:35:31.189248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 352/692] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:31 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:31.412352 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-bc8a241f-c4d8-415e-bb86-fc7c0d1615f2 req-94d5e6a5-6312-41bd-b5c3-63affb536ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd17ee8-9df4-4b0b-b150-574fed351dde", "name": "network-vif-plugged", "status": "completed", "tag": "24ac401c-c8b4-41af-97fa-c5c82f0aa6b7"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:31.420301 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-bc8a241f-c4d8-415e-bb86-fc7c0d1615f2 req-94d5e6a5-6312-41bd-b5c3-63affb536ec7 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:31.420748 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-bc8a241f-c4d8-415e-bb86-fc7c0d1615f2 req-94d5e6a5-6312-41bd-b5c3-63affb536ec7 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:31.431687 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-bc8a241f-c4d8-415e-bb86-fc7c0d1615f2 req-94d5e6a5-6312-41bd-b5c3-63affb536ec7 service nova] Creating event network-vif-plugged:24ac401c-c8b4-41af-97fa-c5c82f0aa6b7 for instance edd17ee8-9df4-4b0b-b150-574fed351dde on hv-cinder-84112 May 09 18:35:31.436791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-bc8a241f-c4d8-415e-bb86-fc7c0d1615f2 req-94d5e6a5-6312-41bd-b5c3-63affb536ec7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147654 May 09 18:35:31.437382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 341/693] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:32.207614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:32.208229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:32.214521 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.214971 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:32.215766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:32.216205 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:32.346769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:32.355694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:32.357202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:32.358373 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4bf46cb6-5583-4eea-9306-b21059b63c93 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1743 microversion: 2.20 time: 0.154682 May 09 18:35:32.358930 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 353/694] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:32 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:35:33.378151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:33.378923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:33.385282 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:33.385747 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:33.386563 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:33.387011 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:33.530588 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:33.539287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:33.542426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:33.543656 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3893d291-fcba-4c5a-bd54-fbbdf7fb70a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.170314 May 09 18:35:33.544449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 342/695] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:33 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:34.563983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:34.564530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:34.572002 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.573229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.574882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:34.575949 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:34.739981 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:34.748943 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:34.751335 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:34.752865 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b2d582f6-bf3f-43f5-97e5-41a52ab46c1a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.193814 May 09 18:35:34.754538 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 354/696] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:34 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:35.772733 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:35.775550 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:35.784015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.784587 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.785462 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:35.785944 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:35.942492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:35.959802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:35.962211 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:35.964115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ee7d45c9-f2af-4f4f-a4e4-bdd30c38b6a7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.196162 May 09 18:35:35.964928 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 343/697] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:35 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:36.989666 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:36.991152 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:36.998111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:36.998649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:36.999712 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:37.000362 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:37.171541 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:37.183336 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:37.184855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:37.186044 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1bc5f102-8528-4465-acce-16a43859842a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.204917 May 09 18:35:37.198322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 355/698] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:36 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:38.206544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:38.207905 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:38.215240 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.215923 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.219471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:38.221076 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:38.387320 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:38.395741 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:38.397016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:38.399518 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7d9ac3f8-a7f6-4c7e-8458-ed70414074d9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.196547 May 09 18:35:38.400249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 344/699] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:38 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:39.418244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:39.419641 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:39.427473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:39.427950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:39.428916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:39.429392 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:39.580137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:39.588214 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:39.589843 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:39.591095 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5e750aa2-d604-42cd-9526-8e8b047119e5 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.177063 May 09 18:35:39.591969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 356/700] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:39 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:40.616772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:40.616772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:40.621563 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:40.622292 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:40.623105 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:40.623587 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:40.793125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:40.804328 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:40.805865 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:40.807038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-52eaae24-38fc-4029-ac56-098e0fd10213 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.198662 May 09 18:35:40.818149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 345/701] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:40 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:41.827052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:41.827787 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:41.834837 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:41.835400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:41.836338 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:41.836775 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:41.963924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:41.971622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:41.973789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:41.974958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dd8a06aa-0ae9-4c65-a0cc-a22b1e2470be tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1738 microversion: 2.20 time: 0.153013 May 09 18:35:41.975547 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 357/702] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:41 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:35:42.516151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c157a36f-0c41-468b-807f-c37d9e3a5d05 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:42.516729 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c157a36f-0c41-468b-807f-c37d9e3a5d05 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:42.522885 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c157a36f-0c41-468b-807f-c37d9e3a5d05 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:42.523379 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c157a36f-0c41-468b-807f-c37d9e3a5d05 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:42.524181 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c157a36f-0c41-468b-807f-c37d9e3a5d05 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:42.524621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c157a36f-0c41-468b-807f-c37d9e3a5d05 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:42.551994 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c157a36f-0c41-468b-807f-c37d9e3a5d05 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039093 May 09 18:35:42.552573 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 346/703] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:35:42 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:42.993014 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:42.993715 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:43.000145 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:43.000618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:43.001373 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:43.001817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:43.132161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:43.139667 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:43.141164 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:43.142920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c8d06e73-e21e-49b4-adff-d09e6ddee05f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1720 microversion: 2.20 time: 0.154164 May 09 18:35:43.143524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 358/704] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:42 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:43.898437 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-24a82e27-615a-44f1-baee-647c422d2b66 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fff0632-7b8a-4c17-86a7-a6a8e0c98299"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:43.899544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-24a82e27-615a-44f1-baee-647c422d2b66 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:43.905817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24a82e27-615a-44f1-baee-647c422d2b66 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:43.906283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24a82e27-615a-44f1-baee-647c422d2b66 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:43.907057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24a82e27-615a-44f1-baee-647c422d2b66 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:43.907529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24a82e27-615a-44f1-baee-647c422d2b66 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:44.161991 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:44.162714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:44.169362 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:44.169907 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:44.171245 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:44.171707 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:44.312799 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:44.321253 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:44.322751 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:44.324020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4a6e3bab-b104-4f62-b271-81177fa51a3e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1720 microversion: 2.20 time: 0.166464 May 09 18:35:44.324701 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 359/705] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:44 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:45.343939 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:45.344529 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:45.351386 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:45.351855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:45.352638 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:45.353088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:45.487199 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:45.496600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:45.498497 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:45.499950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e8d885bb-5aaf-49ce-b343-b875bf59d5dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1720 microversion: 2.20 time: 0.159772 May 09 18:35:45.500514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 360/706] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:45 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:35:45.749764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-24a82e27-615a-44f1-baee-647c422d2b66 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "POST /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.855614 May 09 18:35:45.750557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 347/707] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:35:43 2022] POST /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments => generated 194 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:46.518418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:46.519056 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:46.525389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:46.525845 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:46.526614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:46.527057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:46.650176 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:46.659130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:46.661298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:46.662483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-75eec8a9-c0af-4897-b1d3-4bb18ea9ab7e tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1723 microversion: 2.20 time: 0.147868 May 09 18:35:46.663052 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 361/708] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:46 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:46.681497 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2bc9d91d-da24-4da9-b674-6395d1a34189 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b7c277c-230d-480d-a1eb-afd9a18c1b27"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:46.682639 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2bc9d91d-da24-4da9-b674-6395d1a34189 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:46.688745 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bc9d91d-da24-4da9-b674-6395d1a34189 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:46.689198 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bc9d91d-da24-4da9-b674-6395d1a34189 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:46.689984 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bc9d91d-da24-4da9-b674-6395d1a34189 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:46.690407 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bc9d91d-da24-4da9-b674-6395d1a34189 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:46.940314 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2bc9d91d-da24-4da9-b674-6395d1a34189 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.264148 May 09 18:35:46.940924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 348/709] 10.222.0.25 () {62 vars in 1363 bytes} [Mon May 9 18:35:46 2022] POST /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-volume_attachments => generated 188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 18:35:47.053265 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8b6b03ed-c852-4975-9e04-1d7befa537aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:47.053767 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8b6b03ed-c852-4975-9e04-1d7befa537aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:47.059469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b6b03ed-c852-4975-9e04-1d7befa537aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:47.059924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b6b03ed-c852-4975-9e04-1d7befa537aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:47.060694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b6b03ed-c852-4975-9e04-1d7befa537aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:47.061141 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b6b03ed-c852-4975-9e04-1d7befa537aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.317482 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8b6b03ed-c852-4975-9e04-1d7befa537aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-volume_attachments/5b7c277c-230d-480d-a1eb-afd9a18c1b27" status: 202 len: 0 microversion: 2.20 time: 1.267946 May 09 18:35:48.318438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 362/710] 10.222.0.25 () {60 vars in 1456 bytes} [Mon May 9 18:35:47 2022] DELETE /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-volume_attachments/5b7c277c-230d-480d-a1eb-afd9a18c1b27 => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 18:35:48.349808 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-c97715eb-239b-493c-ab08-d84e62d8024b req-5902dc96-7b67-4500-86df-4043a458165f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd17ee8-9df4-4b0b-b150-574fed351dde", "name": "network-vif-unplugged", "status": "completed", "tag": "24ac401c-c8b4-41af-97fa-c5c82f0aa6b7"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:48.359663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-c97715eb-239b-493c-ab08-d84e62d8024b req-5902dc96-7b67-4500-86df-4043a458165f service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:48.360188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-c97715eb-239b-493c-ab08-d84e62d8024b req-5902dc96-7b67-4500-86df-4043a458165f service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.372422 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-c97715eb-239b-493c-ab08-d84e62d8024b req-5902dc96-7b67-4500-86df-4043a458165f service nova] Creating event network-vif-unplugged:24ac401c-c8b4-41af-97fa-c5c82f0aa6b7 for instance edd17ee8-9df4-4b0b-b150-574fed351dde on hv-cinder-84112 May 09 18:35:48.377746 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-c97715eb-239b-493c-ab08-d84e62d8024b req-5902dc96-7b67-4500-86df-4043a458165f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032315 May 09 18:35:48.378341 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 349/711] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:35:48.380818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bab9bfac-8122-463a-b784-188559d15ec9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:48.381407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bab9bfac-8122-463a-b784-188559d15ec9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:48.387950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bab9bfac-8122-463a-b784-188559d15ec9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:48.388417 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bab9bfac-8122-463a-b784-188559d15ec9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.389229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bab9bfac-8122-463a-b784-188559d15ec9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:48.389651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bab9bfac-8122-463a-b784-188559d15ec9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.463135 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bab9bfac-8122-463a-b784-188559d15ec9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "POST /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/action" status: 202 len: 0 microversion: 2.20 time: 0.086170 May 09 18:35:48.463900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 363/712] 10.222.0.25 () {62 vars in 1318 bytes} [Mon May 9 18:35:48 2022] POST /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 09 18:35:48.473888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:48.473888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:48.480003 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:48.480397 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.481242 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:48.481774 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:48.670123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:48.678417 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:48.680218 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:48.681716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-871eaed3-ddbc-426c-90a1-1610e450c9a9 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1731 microversion: 2.20 time: 0.213270 May 09 18:35:48.694998 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 350/713] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:48 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:49.700878 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:49.701508 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:49.708047 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:49.708508 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:49.709291 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:49.709738 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:49.855062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:49.863972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:49.865506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:49.866697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-92569478-58dc-4c0d-8288-9ffc591ccbee tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.170233 May 09 18:35:49.867600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 364/714] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:49 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:50.889792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:50.890419 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:50.897043 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:50.897515 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:50.898307 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:50.898757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:51.061693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:51.073997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:51.076001 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:51.077469 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fe7bc584-7dbf-404a-9cdd-489b25e0fd79 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.191432 May 09 18:35:51.078431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 351/715] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:50 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:52.098812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:52.099548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:52.106378 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:52.106835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:52.107653 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:52.108102 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:52.268506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:52.282959 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:52.284947 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:52.286825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2b1bbf88-6645-46d7-b9c4-52ab418d4777 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.194866 May 09 18:35:52.287711 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 365/716] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:52 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:53.306198 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:53.306936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:53.313751 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:53.314337 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:53.315252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:53.315910 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:53.477404 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:53.486143 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:53.487704 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:53.489130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0d779d6f-5ac4-425e-aeb5-9b430586b23d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.188494 May 09 18:35:53.489880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 352/717] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:53 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:54.715024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:54.715710 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:54.721996 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:54.723289 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:54.724093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:54.724726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:54.892854 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:54.901926 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:54.903527 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:54.908134 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-413dabad-8df9-4001-9789-cc11ea000fec tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.403206 May 09 18:35:54.908822 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 366/718] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:54 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:55.928673 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:55.929319 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:55.935887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:55.936632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:55.937426 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:55.938033 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:56.104572 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:56.112246 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:56.114394 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:56.115619 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1ec380ea-8bbb-4815-9175-ae0e6d67d137 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.191014 May 09 18:35:56.116312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 353/719] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:55 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:57.134511 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:57.135279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:57.142077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:57.142649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:57.143559 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:57.144119 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:57.309748 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:57.318788 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:57.320649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:57.322349 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b8ba58de-471f-4820-a227-169ec0ef8e0d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.191624 May 09 18:35:57.323488 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 367/720] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:57 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:57.459953 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1051335075", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "networks": [{"uuid": "b57d7f0b-92ae-439d-91c0-77be8f7f50c8"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:35:57.521601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] validate_networks() for [('b57d7f0b-92ae-439d-91c0-77be8f7f50c8', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:35:57.882311 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:35:57.882743 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:35:57.883246 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:35:57.883663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:35:57.884077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:35:57.893821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:57.895071 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:57.897094 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:57.897567 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:57.916548 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Getting quotas for project 64dd788fefab4eeab253b0f0d341fd2d. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:35:57.920629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Getting quotas for user b2e8f8cb607649c0836a9c709791fc0e and project 64dd788fefab4eeab253b0f0d341fd2d. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:35:57.931835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:35:57.934107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:35:58.017146 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-45fc0278-20f1-42dc-a684-4db8f0b94bef tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561252 May 09 18:35:58.017928 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 354/721] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:35:58.028904 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3d9676b0-2ffc-4098-9ecb-fa6b5231b8fb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:58.028904 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3d9676b0-2ffc-4098-9ecb-fa6b5231b8fb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:58.094143 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3d9676b0-2ffc-4098-9ecb-fa6b5231b8fb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:58.103472 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3d9676b0-2ffc-4098-9ecb-fa6b5231b8fb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1219 microversion: 2.1 time: 0.078283 May 09 18:35:58.104692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 368/722] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:58 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:35:58.341424 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:58.342047 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:58.350040 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:58.350507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:58.351404 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:58.351771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:58.508962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:58.517884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:58.525073 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:58.526498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9725a564-2222-4120-bfb6-ff991533ae0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.188918 May 09 18:35:58.527438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 355/723] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:58 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:35:59.121982 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:59.122598 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:59.128859 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.129319 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.130093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.130547 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.190519 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:59.197792 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3bbb932e-2ecd-477b-9bf6-76b8d404a900 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1223 microversion: 2.1 time: 0.079915 May 09 18:35:59.198356 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 369/724] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:35:59 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:35:59.545154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:35:59.545781 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:35:59.552917 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.553381 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.554167 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:35:59.554616 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:35:59.687166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:59.695122 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:59.696665 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:35:59.697829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0aa4bfdc-5395-4295-9a43-ae2d5e77de02 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.156590 May 09 18:35:59.698395 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 356/725] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:35:59 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:00.214670 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:00.215212 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:00.221527 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.222540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.223390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.223842 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.286488 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:00.293622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9293b7e3-02e1-4b4b-9dbc-e913448dccdc tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1215 microversion: 2.1 time: 0.083030 May 09 18:36:00.294195 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 370/726] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:00 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:00.716043 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:00.716672 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:00.723978 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.724443 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.725236 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:00.725690 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:00.852771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:00.860476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:00.862041 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:00.863229 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-91a401d6-e111-45cd-8fba-fdac7e506a09 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.151115 May 09 18:36:00.863795 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 357/727] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:00 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:01.311507 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:01.313042 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:01.319698 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.320168 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:01.320966 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.321416 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:01.387211 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:01.395124 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-42975f84-af27-49dd-825f-494ffcc9f981 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1277 microversion: 2.1 time: 0.088200 May 09 18:36:01.396078 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 371/728] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:01 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:01.881494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:01.882128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:01.888542 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.889486 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:01.890744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.891392 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:01.896108 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:01.896815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:01.906396 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.907139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:01.908189 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:01.908787 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.002238 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lazy-loading 'services' on Instance uuid a95113e2-f278-45ae-afa3-7d1bee1e08a1 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:02.033379 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:02.041536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:02.043130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:02.044416 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-65689d7e-1bb5-40f2-a29d-05b96e36eb0b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.167052 May 09 18:36:02.045249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 358/729] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:01 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:02.078390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-53272177-a9ab-4160-80d6-3a9ceea25841 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments/2fff0632-7b8a-4c17-86a7-a6a8e0c98299" status: 202 len: 0 microversion: 2.1 time: 0.187089 May 09 18:36:02.082070 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 372/730] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:36:01 2022] DELETE /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments/2fff0632-7b8a-4c17-86a7-a6a8e0c98299 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:02.087328 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2bfd0baf-0cd8-4566-ba9b-7e90f1340e1c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:02.088612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2bfd0baf-0cd8-4566-ba9b-7e90f1340e1c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:02.095204 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bfd0baf-0cd8-4566-ba9b-7e90f1340e1c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.095808 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bfd0baf-0cd8-4566-ba9b-7e90f1340e1c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.096599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bfd0baf-0cd8-4566-ba9b-7e90f1340e1c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.097161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bfd0baf-0cd8-4566-ba9b-7e90f1340e1c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.129072 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2bfd0baf-0cd8-4566-ba9b-7e90f1340e1c tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 May 09 18:36:02.129646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 359/731] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:36:02 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:02.413331 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:02.414065 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:02.420510 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.420962 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.421740 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.422182 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.557436 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:02.564610 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5b0fc90e-65fb-4ab8-b0cc-868128077637 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1319 microversion: 2.1 time: 0.155965 May 09 18:36:02.565239 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 373/732] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:02 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:02.612624 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-d82786c3-8f33-4830-a93b-e1cff624a130 req-b5ff82cb-bca2-4a7f-af11-7720bfaf1743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba0e19b2-bf67-4740-af3f-3c78ae117327", "tag": "34a62ebb-9a32-4a9c-b58d-d0f3d59b133e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:02.620827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d82786c3-8f33-4830-a93b-e1cff624a130 req-b5ff82cb-bca2-4a7f-af11-7720bfaf1743 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:02.621272 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d82786c3-8f33-4830-a93b-e1cff624a130 req-b5ff82cb-bca2-4a7f-af11-7720bfaf1743 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:02.633849 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-d82786c3-8f33-4830-a93b-e1cff624a130 req-b5ff82cb-bca2-4a7f-af11-7720bfaf1743 service nova] Creating event network-changed:34a62ebb-9a32-4a9c-b58d-d0f3d59b133e for instance ba0e19b2-bf67-4740-af3f-3c78ae117327 on hv-cinder-84112 May 09 18:36:02.638587 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-d82786c3-8f33-4830-a93b-e1cff624a130 req-b5ff82cb-bca2-4a7f-af11-7720bfaf1743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165399 May 09 18:36:02.639164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 360/733] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:03.063271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:03.063922 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:03.069671 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.070132 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.070913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.071404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.141855 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c2bb761c-3177-4f80-8d71-3ceeffef7f3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:03.143030 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c2bb761c-3177-4f80-8d71-3ceeffef7f3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:03.149779 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2bb761c-3177-4f80-8d71-3ceeffef7f3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.150123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2bb761c-3177-4f80-8d71-3ceeffef7f3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.150965 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2bb761c-3177-4f80-8d71-3ceeffef7f3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.151441 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2bb761c-3177-4f80-8d71-3ceeffef7f3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.179078 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c2bb761c-3177-4f80-8d71-3ceeffef7f3b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042071 May 09 18:36:03.179684 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 361/734] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:36:03 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 09 18:36:03.200350 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:03.209750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:03.211280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:03.212445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fa361d65-4d99-48dd-8e1d-3e367c9e5d1d tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.153261 May 09 18:36:03.213093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 374/735] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:03 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:03.235641 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:03.236164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:03.242145 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.242604 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.243418 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.243870 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.272768 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:03.348085 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8ad11540-08ff-418b-a276-4a828fb7b6e1 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 204 len: 0 microversion: 2.1 time: 0.115906 May 09 18:36:03.348579 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 362/736] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:03 2022] DELETE /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:03.357383 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:03.358007 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:03.363858 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.364321 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.365100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.365551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.477580 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-78ca9eb7-2c71-4150-b99b-40f9ba4e61e0 req-21154b57-16e0-4a8b-86cb-603864988cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd17ee8-9df4-4b0b-b150-574fed351dde", "name": "network-vif-plugged", "status": "completed", "tag": "24ac401c-c8b4-41af-97fa-c5c82f0aa6b7"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:03.490224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-78ca9eb7-2c71-4150-b99b-40f9ba4e61e0 req-21154b57-16e0-4a8b-86cb-603864988cf0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.491296 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-78ca9eb7-2c71-4150-b99b-40f9ba4e61e0 req-21154b57-16e0-4a8b-86cb-603864988cf0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.501509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:03.506594 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-78ca9eb7-2c71-4150-b99b-40f9ba4e61e0 req-21154b57-16e0-4a8b-86cb-603864988cf0 service nova] Creating event network-vif-plugged:24ac401c-c8b4-41af-97fa-c5c82f0aa6b7 for instance edd17ee8-9df4-4b0b-b150-574fed351dde on hv-cinder-84112 May 09 18:36:03.511705 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-78d2751a-15fe-484a-9d0d-532f2613140b tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1681 microversion: 2.1 time: 0.158083 May 09 18:36:03.511955 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-78ca9eb7-2c71-4150-b99b-40f9ba4e61e0 req-21154b57-16e0-4a8b-86cb-603864988cf0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038620 May 09 18:36:03.512810 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 375/737] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:03 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:03.512971 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 363/738] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:03.581551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:03.582184 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:03.588369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.588828 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.589611 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:03.590090 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:03.720706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:03.728314 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-85e0a33a-0ce1-4021-930b-74e6f8adb776 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1319 microversion: 2.1 time: 0.150732 May 09 18:36:03.728913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 376/739] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:03 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:04.230355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:04.231031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:04.238156 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.238615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.239418 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.239861 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.281598 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3291d168-9468-494a-9668-82377849c1b9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:04.282116 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3291d168-9468-494a-9668-82377849c1b9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:04.288455 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3291d168-9468-494a-9668-82377849c1b9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.288910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3291d168-9468-494a-9668-82377849c1b9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.289689 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3291d168-9468-494a-9668-82377849c1b9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.290131 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3291d168-9468-494a-9668-82377849c1b9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.312632 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3291d168-9468-494a-9668-82377849c1b9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/ips" status: 200 len: 145 microversion: 2.1 time: 0.034781 May 09 18:36:04.313205 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 377/740] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:36:04 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:04.370908 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:04.379392 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:04.380897 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:04.382072 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e3ce4ee3-1041-4edb-ad1d-05c4a1f77913 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.156008 May 09 18:36:04.382947 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 364/741] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:04 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:04.529053 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:04.529673 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:04.536936 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.537392 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.538172 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.538615 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.672159 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:04.679514 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7399e774-3dac-449c-8c0a-510e66b08c0e tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1681 microversion: 2.1 time: 0.154479 May 09 18:36:04.680091 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 378/742] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:04 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:04.745847 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:04.746670 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:04.752703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.753524 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.754358 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:04.754803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:04.880648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:04.887863 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dd291c37-b894-462c-bd66-66bba3913117 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1319 microversion: 2.1 time: 0.146000 May 09 18:36:04.888428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 365/743] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:04 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:05.401158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:05.402015 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:05.408211 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.408672 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.410876 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.411376 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.634491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-966ede56-a422-4733-85f3-b13043afce17 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92211557-97c4-4c3f-8d61-6056cb2a1917"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:05.635674 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-966ede56-a422-4733-85f3-b13043afce17 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:05.642370 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-966ede56-a422-4733-85f3-b13043afce17 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.642830 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-966ede56-a422-4733-85f3-b13043afce17 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.643703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-966ede56-a422-4733-85f3-b13043afce17 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.644151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-966ede56-a422-4733-85f3-b13043afce17 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.876304 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:05.887562 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:05.892728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:05.896679 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-95755b2a-b0e4-480e-b055-138f1e046531 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.497130 May 09 18:36:05.898059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 379/744] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:05 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:05.905146 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:05.905987 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:05.916411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.917182 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:05.918264 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:05.919126 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:06.014854 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-966ede56-a422-4733-85f3-b13043afce17 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383934 May 09 18:36:06.021690 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 366/745] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:36:05 2022] POST /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:06.026338 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:06.027073 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:06.035286 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:06.036101 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:06.036918 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:06.037374 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:06.204930 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:06.213002 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f2e9315e-96f4-4027-a8e8-7684c10c6450 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1681 microversion: 2.1 time: 0.311482 May 09 18:36:06.213658 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 380/746] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:05 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1681 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:06.301271 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:06.308967 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c5804eb6-c3fd-4652-b4e3-c6501d4a2831 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1319 microversion: 2.1 time: 0.288751 May 09 18:36:06.309545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 367/747] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:06 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:06.876306 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-6ad3af88-7ee8-4417-b3a3-5d65ced0af65 req-b41edfa2-7ebc-49bc-8c7b-9243c016c252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95113e2-f278-45ae-afa3-7d1bee1e08a1", "name": "network-vif-deleted", "tag": "6565f8c1-96d5-4ffe-82fd-eba43170e663"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:06.884733 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6ad3af88-7ee8-4417-b3a3-5d65ced0af65 req-b41edfa2-7ebc-49bc-8c7b-9243c016c252 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:06.885450 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6ad3af88-7ee8-4417-b3a3-5d65ced0af65 req-b41edfa2-7ebc-49bc-8c7b-9243c016c252 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:06.896828 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-6ad3af88-7ee8-4417-b3a3-5d65ced0af65 req-b41edfa2-7ebc-49bc-8c7b-9243c016c252 service nova] Creating event network-vif-deleted:6565f8c1-96d5-4ffe-82fd-eba43170e663 for instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 on hv-cinder-84112 May 09 18:36:06.901637 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-6ad3af88-7ee8-4417-b3a3-5d65ced0af65 req-b41edfa2-7ebc-49bc-8c7b-9243c016c252 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029087 May 09 18:36:06.902534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 381/748] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:06.916605 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:06.917246 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:06.925569 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:06.926189 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:06.927166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:06.927643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.131678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:07.143627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:07.145509 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:07.146935 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4ac70ab3-d869-488d-bdf0-acebf6066c4b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1729 microversion: 2.20 time: 0.235146 May 09 18:36:07.149341 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 368/749] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:06 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:07.230750 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:07.231615 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:07.238730 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.239293 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.240305 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.240817 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.273409 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.273969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.274548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lazy-loading 'fault' on Instance uuid a95113e2-f278-45ae-afa3-7d1bee1e08a1 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:07.325831 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:07.326930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:07.345279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99208187e4e4d2eb9f52107ae8f50f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582c1a023c645b38b91a5fa01be7667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:07.349911 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.351623 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.352549 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.354009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.358553 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3fb34e23-f2d8-4331-86de-515608f24f13 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 200 len: 1331 microversion: 2.1 time: 0.132277 May 09 18:36:07.360116 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 382/750] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:07 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:07.554597 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:07.562540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ef30aab4-ed56-4b58-87fb-9a3f13be33ca tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1319 microversion: 2.1 time: 0.240475 May 09 18:36:07.563125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 369/751] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:07 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:07.596100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-2004710d-ca43-48ae-abd6-8fd20cb895b7 req-5d1b5c9f-d2ed-4b8e-83d1-6e8c338f07be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0e19b2-bf67-4740-af3f-3c78ae117327", "name": "network-vif-plugged", "status": "completed", "tag": "34a62ebb-9a32-4a9c-b58d-d0f3d59b133e"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:07.608031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2004710d-ca43-48ae-abd6-8fd20cb895b7 req-5d1b5c9f-d2ed-4b8e-83d1-6e8c338f07be service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:07.609232 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2004710d-ca43-48ae-abd6-8fd20cb895b7 req-5d1b5c9f-d2ed-4b8e-83d1-6e8c338f07be service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:07.622596 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-2004710d-ca43-48ae-abd6-8fd20cb895b7 req-5d1b5c9f-d2ed-4b8e-83d1-6e8c338f07be service nova] Creating event network-vif-plugged:34a62ebb-9a32-4a9c-b58d-d0f3d59b133e for instance ba0e19b2-bf67-4740-af3f-3c78ae117327 on hv-cinder-84112 May 09 18:36:07.627828 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-2004710d-ca43-48ae-abd6-8fd20cb895b7 req-5d1b5c9f-d2ed-4b8e-83d1-6e8c338f07be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037530 May 09 18:36:07.629622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 383/752] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:08.166201 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:08.166834 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:08.172829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.173299 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.174091 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.174546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.300356 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:08.308004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:08.309526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:08.310692 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-70771093-728e-459b-b9a9-8dfce9240f9f tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1716 microversion: 2.20 time: 0.148443 May 09 18:36:08.311287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 370/753] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:08 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:08.376907 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:08.377554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:08.384204 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.384664 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.385436 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.385883 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.399410 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 HTTP/1.1 May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:08.401034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:08.402570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'a95113e2-f278-45ae-afa3-7d1bee1e08a1'} May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:08.403506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:08.404992 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:08.406250 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:08.406250 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e87d1962-3d7e-4636-8ec6-c78817bbe9e3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 404 len: 111 microversion: 2.1 time: 0.030250 May 09 18:36:08.406250 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 384/754] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:08 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:08.411030 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bf2acc54-f7c9-4daa-95cd-1c2ab9e8eea0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '.version_select at 0x7f3f7e6ac700>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:08.427800 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bf2acc54-f7c9-4daa-95cd-1c2ab9e8eea0 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881396961" status: 202 len: 0 microversion: 2.1 time: 0.020535 May 09 18:36:08.428363 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 371/755] 10.222.0.25 () {58 vars in 1220 bytes} [Mon May 9 18:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881396961 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:08.580769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:08.582302 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:08.589287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.592923 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.594407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:08.595670 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:08.727147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:08.734648 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0052a4dd-d360-418e-bede-b2957b6ee67e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1319 microversion: 2.1 time: 0.158884 May 09 18:36:08.735324 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 385/756] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:08 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:09.751525 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:09.752154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:09.758339 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:09.758801 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:09.759698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:09.760151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:09.888637 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:09.896566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2eba4422-5450-4adf-8203-3bdab09f231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1507 microversion: 2.1 time: 0.148999 May 09 18:36:09.897132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 372/757] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:09 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:10.161303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:10.161816 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:10.168584 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:10.169049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:10.169836 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:10.170293 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:10.183647 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 HTTP/1.1 May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:10.185247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.186920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'a95113e2-f278-45ae-afa3-7d1bee1e08a1'} May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:10.187825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.189231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:10.191147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:10.191147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b9cf550a-2be5-4225-ab27-401471b67d5f tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 404 len: 111 microversion: 2.1 time: 0.029290 May 09 18:36:10.191147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 386/758] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:10 2022] DELETE /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:10.199835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:10.200530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: a95113e2-f278-45ae-afa3-7d1bee1e08a1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:10.207068 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:10.207732 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:10.208483 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:10.209006 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:10.222554 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 HTTP/1.1 May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:36:10.224406 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.225891 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'a95113e2-f278-45ae-afa3-7d1bee1e08a1'} May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:10.226755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. May 09 18:36:10.228346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:10.229632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance a95113e2-f278-45ae-afa3-7d1bee1e08a1 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:10.229632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a28a576a-17c8-4d1c-9a25-7132d0bb1bc3 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1" status: 404 len: 111 microversion: 2.1 time: 0.031495 May 09 18:36:10.229632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 373/759] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:10 2022] GET /compute/v2.1/servers/a95113e2-f278-45ae-afa3-7d1bee1e08a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:11.387134 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:11.387907 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:11.394620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.395654 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.396458 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.396911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.410609 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 HTTP/1.1 May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:11.412446 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.413759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'ed8b23f6-bf09-4784-bed1-4e2a9c013f91'} May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:11.414537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.415804 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.416972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:11.416972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c77755e3-9e6f-4510-a7e4-23b78b031ace tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 404 len: 111 microversion: 2.1 time: 0.030654 May 09 18:36:11.416972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 387/760] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:11 2022] DELETE /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:11.425073 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:11.425692 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: ed8b23f6-bf09-4784-bed1-4e2a9c013f91] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:11.432010 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.432466 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.433233 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.433675 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.447776 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 HTTP/1.1 May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:36:11.449297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.450772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'ed8b23f6-bf09-4784-bed1-4e2a9c013f91'} May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:11.451648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. May 09 18:36:11.453027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.454270 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance ed8b23f6-bf09-4784-bed1-4e2a9c013f91 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:11.454270 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e63479b2-8c71-4bfb-9822-329e6584f5c4 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91" status: 404 len: 111 microversion: 2.1 time: 0.029444 May 09 18:36:11.454270 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 374/761] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:11 2022] GET /compute/v2.1/servers/ed8b23f6-bf09-4784-bed1-4e2a9c013f91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:11.459824 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:11.460363 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:11.466330 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.466795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.467619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.468070 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.481554 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 HTTP/1.1 May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:11.483107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.484431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '79b90383-7829-430d-ba18-361f2ef96634'} May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:11.485139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.486438 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:11.488188 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:11.488188 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-85ea809e-5b0f-4b46-bb98-3f189ab83479 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 404 len: 111 microversion: 2.1 time: 0.029286 May 09 18:36:11.488188 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 388/762] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:11 2022] DELETE /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:11.492932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:11.493552 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 79b90383-7829-430d-ba18-361f2ef96634] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:11.499741 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.500209 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.501005 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:11.501459 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:11.515714 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 HTTP/1.1 May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:36:11.517265 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.518803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '79b90383-7829-430d-ba18-361f2ef96634'} May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:11.520279 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. May 09 18:36:11.521694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:11.522990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance 79b90383-7829-430d-ba18-361f2ef96634 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:11.522990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3486a086-47df-46a1-9247-c5ced2f655e2 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634" status: 404 len: 111 microversion: 2.1 time: 0.029537 May 09 18:36:11.522990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 375/763] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:11 2022] GET /compute/v2.1/servers/79b90383-7829-430d-ba18-361f2ef96634 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:12.652031 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:12.652575 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:12.659949 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:12.661020 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:12.661816 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:12.662263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:12.675586 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f HTTP/1.1 May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:12.678000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.679714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f'} May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:12.680702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.682153 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:12.683889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:12.683889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-38573e20-e776-49bd-aac1-3e472447c592 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 404 len: 111 microversion: 2.1 time: 0.031247 May 09 18:36:12.683889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 389/764] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:12 2022] DELETE /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:12.688348 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:12.688971 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] [instance: 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:12.696075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:12.696558 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:12.697326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:12.697794 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:12.712629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] HTTP exception thrown: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Request method failure captured: May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f HTTP/1.1 May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2ZFR27xNEHNjeVa_I6m0zNkhsQUtdRf1ywxpXVgne8wmEO2s-8-SLQ6xZoj_uywV1Ge57-48aJ03ELXPo4nd1dedlZMvfMVdgbc5rDpuGCUoguF3RJV8guI4zZmhHyrpyEzu3Vll4VbzhzPty_sT4Ylq4F2x88mCkKf5vrJgTYJpI May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:36:12.714629 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3582c1a023c645b38b91a5fa01be7667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3582c1a023c645b38b91a5fa01be7667"}]}] May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 3582c1a023c645b38b91a5fa01be7667 May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920723765 May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: f99208187e4e4d2eb9f52107ae8f50f2 May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeNegativeTest-1920723765-project May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.716316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f'} May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:12.717194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. May 09 18:36:12.718450 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:12.719576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] Returning 404 to user: Instance 9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:12.719576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-454d2a2e-91d5-4134-82cb-1ea89fe6db75 tempest-AttachVolumeNegativeTest-1920723765 tempest-AttachVolumeNegativeTest-1920723765-project] 10.222.0.25 "GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f" status: 404 len: 111 microversion: 2.1 time: 0.031608 May 09 18:36:12.719576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 376/765] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:12 2022] GET /compute/v2.1/servers/9e0f5dd8-6ab2-4a79-b7be-60d3de02ef9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:13.587639 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9484ba92-7011-40b8-b3e9-f7335c18f31e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:13.588593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9484ba92-7011-40b8-b3e9-f7335c18f31e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:13.597516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9484ba92-7011-40b8-b3e9-f7335c18f31e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:13.598524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9484ba92-7011-40b8-b3e9-f7335c18f31e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:13.599381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9484ba92-7011-40b8-b3e9-f7335c18f31e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:13.599835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9484ba92-7011-40b8-b3e9-f7335c18f31e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:13.631237 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9484ba92-7011-40b8-b3e9-f7335c18f31e tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047481 May 09 18:36:13.631916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 390/766] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:36:13 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:13.641712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-044d07d9-cc8f-42df-b62d-965bcfea49a1 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:13.642296 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-044d07d9-cc8f-42df-b62d-965bcfea49a1 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:13.648419 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-044d07d9-cc8f-42df-b62d-965bcfea49a1 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:13.648887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-044d07d9-cc8f-42df-b62d-965bcfea49a1 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:13.649677 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-044d07d9-cc8f-42df-b62d-965bcfea49a1 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:13.650129 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-044d07d9-cc8f-42df-b62d-965bcfea49a1 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:13.680652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-044d07d9-cc8f-42df-b62d-965bcfea49a1 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/92211557-97c4-4c3f-8d61-6056cb2a1917" status: 200 len: 194 microversion: 2.1 time: 0.042800 May 09 18:36:13.681437 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 377/767] 10.222.0.25 () {58 vars in 1412 bytes} [Mon May 9 18:36:13 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/92211557-97c4-4c3f-8d61-6056cb2a1917 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:36:15.030618 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ddb1fcfa-5e5b-48fd-bb42-0ec34ce4eb62 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9b5d226-93ce-4665-91ad-909034fc2813"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:15.031734 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ddb1fcfa-5e5b-48fd-bb42-0ec34ce4eb62 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:15.039351 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddb1fcfa-5e5b-48fd-bb42-0ec34ce4eb62 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:15.039991 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddb1fcfa-5e5b-48fd-bb42-0ec34ce4eb62 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:15.041111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddb1fcfa-5e5b-48fd-bb42-0ec34ce4eb62 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:15.041569 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddb1fcfa-5e5b-48fd-bb42-0ec34ce4eb62 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:15.327747 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ddb1fcfa-5e5b-48fd-bb42-0ec34ce4eb62 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "POST /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300907 May 09 18:36:15.328359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 391/768] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:36:15 2022] POST /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:17.242127 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2963cf1f-3fdb-43b1-b3cb-a96f230efd33 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Action: 'create', calling method: .version_select at 0x7f3f7e6ac700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-361005503", "metadata": {"Type": "work"}}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:17.527116 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2963cf1f-3fdb-43b1-b3cb-a96f230efd33 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.398594 May 09 18:36:17.527772 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 378/769] 10.222.0.25 () {60 vars in 1155 bytes} [Mon May 9 18:36:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 18:36:17.540067 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1b182bad-c8b6-4d24-a650-8e139f8a086f tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Calling method '.version_select at 0x7f3f839a6430>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:17.588032 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1b182bad-c8b6-4d24-a650-8e139f8a086f tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7" status: 200 len: 352 microversion: 2.1 time: 0.052700 May 09 18:36:17.588629 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 392/770] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:36:17 2022] GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:18.602135 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-df4697c5-5e89-4408-aaa1-ba2db027e5db tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Calling method '.version_select at 0x7f3f7e6ce9d0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:18.648934 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-df4697c5-5e89-4408-aaa1-ba2db027e5db tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7" status: 200 len: 353 microversion: 2.1 time: 0.051601 May 09 18:36:18.649545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 379/771] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:36:18 2022] GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:18.662569 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a14f5d60-6135-4cd4-8287-48170d4620ff tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Calling method '.version_select at 0x7f3f7f27f820>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:18.709034 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a14f5d60-6135-4cd4-8287-48170d4620ff tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7" status: 200 len: 353 microversion: 2.1 time: 0.052258 May 09 18:36:18.709646 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 393/772] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:36:18 2022] GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:18.726122 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9e6dc7ec-e0fd-498b-8d1d-aa914f753a01 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Calling method '.version_select at 0x7f3f7e6ac3a0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:18.784102 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9e6dc7ec-e0fd-498b-8d1d-aa914f753a01 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7" status: 202 len: 0 microversion: 2.1 time: 0.062411 May 09 18:36:18.784675 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 380/773] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:36:18 2022] DELETE /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:18.793429 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6df63f7e-fa43-422c-ac11-832290be0285 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Calling method '.version_select at 0x7f3f839ec430>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:18.841429 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6df63f7e-fa43-422c-ac11-832290be0285 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7" status: 200 len: 352 microversion: 2.1 time: 0.051673 May 09 18:36:18.842002 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 394/774] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:36:18 2022] GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:19.854016 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-820ef0a4-47d2-4ccf-948e-396e116cddc7 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Calling method '.version_select at 0x7f3f7e6f4820>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:19.881031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-820ef0a4-47d2-4ccf-948e-396e116cddc7 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] HTTP exception thrown: Volume f005181f-4f84-43f1-bebf-8cc6b09198c7 could not be found. May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-820ef0a4-47d2-4ccf-948e-396e116cddc7 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Request method failure captured: May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7 HTTP/1.1 May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV8ht4_aqE2tA-t7IPyieaOuLwl-l83WfWhtC6RammBciplEhP4vMciJpzpBrbQeVl06h2q26SWVNWfaNDv-Qiz5mkN4HgSRyHv8Sn77vQ6YGjSU2j1RlGugYnU674FvS2Zr4egkTfH5UvnGIgtusTbVz3XPfvBBzIzlRmG0edgDtyM May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 69d14b3d7e924f558cd44f894c41a70c May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesGetTestJSON-851067635 May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:36:19.883149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d14b3d7e924f558cd44f894c41a70c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d14b3d7e924f558cd44f894c41a70c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d14b3d7e924f558cd44f894c41a70c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d14b3d7e924f558cd44f894c41a70c"}]}] May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesGetTestJSON-851067635 May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 69d14b3d7e924f558cd44f894c41a70c May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesGetTestJSON-851067635 May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesGetTestJSON-851067635-project May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: a55eedc9183c430c9db61fb07f168bec May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesGetTestJSON-851067635-project May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Volume f005181f-4f84-43f1-bebf-8cc6b09198c7 could not be found. May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'f005181f-4f84-43f1-bebf-8cc6b09198c7'} May 09 18:36:19.884706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f005181f-4f84-43f1-bebf-8cc6b09198c7 could not be found. (HTTP 404) (Request-ID: req-f1156ccd-87a7-424f-b13f-a8b77beb1bad) May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:19.885698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 18:36:19.887224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f005181f-4f84-43f1-bebf-8cc6b09198c7 could not be found. May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 18:36:19.889088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f005181f-4f84-43f1-bebf-8cc6b09198c7 could not be found. May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f005181f-4f84-43f1-bebf-8cc6b09198c7 could not be found. May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-820ef0a4-47d2-4ccf-948e-396e116cddc7 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] Returning 404 to user: Volume f005181f-4f84-43f1-bebf-8cc6b09198c7 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-820ef0a4-47d2-4ccf-948e-396e116cddc7 tempest-VolumesGetTestJSON-851067635 tempest-VolumesGetTestJSON-851067635-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7" status: 404 len: 109 microversion: 2.1 time: 0.034985 May 09 18:36:19.890962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 381/775] 10.222.0.25 () {58 vars in 1244 bytes} [Mon May 9 18:36:19 2022] GET /compute/v2.1/os-volumes/f005181f-4f84-43f1-bebf-8cc6b09198c7 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:22.824282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2ec07a45-9745-4588-ab4d-e87a2fdaf950 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:22.825522 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2ec07a45-9745-4588-ab4d-e87a2fdaf950 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:22.831724 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec07a45-9745-4588-ab4d-e87a2fdaf950 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:22.832187 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec07a45-9745-4588-ab4d-e87a2fdaf950 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:22.832970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec07a45-9745-4588-ab4d-e87a2fdaf950 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:22.833419 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec07a45-9745-4588-ab4d-e87a2fdaf950 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:22.862666 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2ec07a45-9745-4588-ab4d-e87a2fdaf950 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042782 May 09 18:36:22.863910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 395/776] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:36:22 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:23.026305 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b23a8c58-fc28-4307-ba68-edc2f56ef190 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:23.026783 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b23a8c58-fc28-4307-ba68-edc2f56ef190 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:23.032643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b23a8c58-fc28-4307-ba68-edc2f56ef190 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:23.033126 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b23a8c58-fc28-4307-ba68-edc2f56ef190 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:23.033897 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b23a8c58-fc28-4307-ba68-edc2f56ef190 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:23.034341 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b23a8c58-fc28-4307-ba68-edc2f56ef190 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:23.062515 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b23a8c58-fc28-4307-ba68-edc2f56ef190 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/92211557-97c4-4c3f-8d61-6056cb2a1917" status: 200 len: 194 microversion: 2.1 time: 0.042225 May 09 18:36:23.063108 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 382/777] 10.222.0.25 () {58 vars in 1412 bytes} [Mon May 9 18:36:23 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/92211557-97c4-4c3f-8d61-6056cb2a1917 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:23.075793 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:23.075793 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:23.079613 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:23.080077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:23.080855 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:23.081301 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:23.161102 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lazy-loading 'services' on Instance uuid ff614ce6-f3fe-49aa-97f6-a7c309da1953 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:23.232065 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-23547014-efdc-4f4e-a9d1-560d29aed87c tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/92211557-97c4-4c3f-8d61-6056cb2a1917" status: 202 len: 0 microversion: 2.1 time: 0.163188 May 09 18:36:23.232795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 396/778] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:36:23 2022] DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/92211557-97c4-4c3f-8d61-6056cb2a1917 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:25.394369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-814c550c-74c2-4af0-b5b9-076292542519 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:25.394865 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-814c550c-74c2-4af0-b5b9-076292542519 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:25.401075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-814c550c-74c2-4af0-b5b9-076292542519 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:25.401535 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-814c550c-74c2-4af0-b5b9-076292542519 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:25.402313 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-814c550c-74c2-4af0-b5b9-076292542519 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:25.402759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-814c550c-74c2-4af0-b5b9-076292542519 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:25.430169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-814c550c-74c2-4af0-b5b9-076292542519 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/c9b5d226-93ce-4665-91ad-909034fc2813" status: 200 len: 194 microversion: 2.1 time: 0.039728 May 09 18:36:25.430729 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 383/779] 10.222.0.25 () {58 vars in 1412 bytes} [Mon May 9 18:36:25 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/c9b5d226-93ce-4665-91ad-909034fc2813 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:25.441320 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:25.441910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:25.448749 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:25.449215 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:25.450001 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:25.450481 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:25.526176 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lazy-loading 'services' on Instance uuid ff614ce6-f3fe-49aa-97f6-a7c309da1953 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:25.593732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e302f324-91e7-45e0-bde4-58b05d5024c8 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/c9b5d226-93ce-4665-91ad-909034fc2813" status: 202 len: 0 microversion: 2.1 time: 0.156900 May 09 18:36:25.594322 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 397/780] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:36:25 2022] DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments/c9b5d226-93ce-4665-91ad-909034fc2813 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:29.908287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d75b1c55-a513-4c20-a667-b000335e49e0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:29.909238 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d75b1c55-a513-4c20-a667-b000335e49e0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:29.915451 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d75b1c55-a513-4c20-a667-b000335e49e0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:29.915954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d75b1c55-a513-4c20-a667-b000335e49e0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:29.916734 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d75b1c55-a513-4c20-a667-b000335e49e0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:29.917183 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d75b1c55-a513-4c20-a667-b000335e49e0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:29.946896 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d75b1c55-a513-4c20-a667-b000335e49e0 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042440 May 09 18:36:29.947492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 384/781] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:36:29 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:36:30.049906 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-33b967b7-580e-44ef-a66d-a31e24d034c7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:30.051011 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-33b967b7-580e-44ef-a66d-a31e24d034c7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:30.057681 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-33b967b7-580e-44ef-a66d-a31e24d034c7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.058138 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-33b967b7-580e-44ef-a66d-a31e24d034c7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.058917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-33b967b7-580e-44ef-a66d-a31e24d034c7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.059400 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-33b967b7-580e-44ef-a66d-a31e24d034c7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.091591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-33b967b7-580e-44ef-a66d-a31e24d034c7 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045848 May 09 18:36:30.092071 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 398/782] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:36:30 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:36:30.147303 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:30.148427 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:30.154288 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.154753 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.155560 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.156014 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.179643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:30.254369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cfeb61f3-86cf-463a-8e40-f2be2bc76fa9 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 204 len: 0 microversion: 2.1 time: 0.110448 May 09 18:36:30.255189 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 385/783] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:30 2022] DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:30.262913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4599502a-f6b6-47ca-a69d-bc906ddd15d3 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d94c1cb-cbde-4397-b1ee-e87012be7827", "device": "/dev/sdb"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:30.263792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:30.264556 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4599502a-f6b6-47ca-a69d-bc906ddd15d3 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:30.264757 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:30.270546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.270745 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4599502a-f6b6-47ca-a69d-bc906ddd15d3 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.270993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.271218 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4599502a-f6b6-47ca-a69d-bc906ddd15d3 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.271792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.272247 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.273342 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4599502a-f6b6-47ca-a69d-bc906ddd15d3 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:30.273981 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4599502a-f6b6-47ca-a69d-bc906ddd15d3 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:30.409151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:30.416336 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-368c07ba-5a27-44ee-a73a-8751d12aa572 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1672 microversion: 2.1 time: 0.156629 May 09 18:36:30.416946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 386/784] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:30 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:31.434198 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:31.434867 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:31.441140 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:31.441598 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:31.442362 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:31.442802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:31.571930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:31.579409 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1fb34a23-5f60-4062-8fff-6f2e42cdcabb tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1672 microversion: 2.1 time: 0.149050 May 09 18:36:31.580145 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 387/785] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:31 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:32.032114 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4599502a-f6b6-47ca-a69d-bc906ddd15d3 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "POST /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.773062 May 09 18:36:32.032795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 399/786] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:36:30 2022] POST /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327/os-volume_attachments => generated 194 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:32.597114 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:32.598036 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:32.604832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:32.605612 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:32.606633 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:32.607346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:32.846668 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:32.855511 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b55284aa-9c09-4ae3-8803-ade410b20596 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1672 microversion: 2.1 time: 0.262405 May 09 18:36:32.856473 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 388/787] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:32 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:33.261107 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-5c44bf92-a791-4e39-91cf-d3ea4056401d req-ee02d606-bfcb-4879-a440-6cfcb8693c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff614ce6-f3fe-49aa-97f6-a7c309da1953", "name": "network-vif-deleted", "tag": "4cb5792d-607a-471d-b6dd-c779ad1dc8a6"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:33.271531 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5c44bf92-a791-4e39-91cf-d3ea4056401d req-ee02d606-bfcb-4879-a440-6cfcb8693c32 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:33.272024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5c44bf92-a791-4e39-91cf-d3ea4056401d req-ee02d606-bfcb-4879-a440-6cfcb8693c32 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:33.287085 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-5c44bf92-a791-4e39-91cf-d3ea4056401d req-ee02d606-bfcb-4879-a440-6cfcb8693c32 service nova] Creating event network-vif-deleted:4cb5792d-607a-471d-b6dd-c779ad1dc8a6 for instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 on hv-cinder-84112 May 09 18:36:33.299256 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-5c44bf92-a791-4e39-91cf-d3ea4056401d req-ee02d606-bfcb-4879-a440-6cfcb8693c32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042426 May 09 18:36:33.300209 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 400/788] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:33.873201 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:33.873940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:33.880176 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:33.886045 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:33.887244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:33.887943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:33.924809 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:33.925580 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:33.926194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lazy-loading 'fault' on Instance uuid ff614ce6-f3fe-49aa-97f6-a7c309da1953 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:33.993281 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fdc96d6e6649a498bb3a8659fcc030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78039fb4f0bd454b8aea3db748343263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:34.000333 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3e611d4c-affc-4017-b3c6-0244caa7afb6 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 200 len: 1327 microversion: 2.1 time: 0.131175 May 09 18:36:34.000925 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 389/789] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:33 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:34.541636 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:34.544934 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:34.545671 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-403021a2-19b1-45dd-8bc5-5a37eb6b350c req-b7f59372-23ef-456e-a157-8b2e3c04350e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8243cbea-6bde-4ac9-8f5a-53ec888ed813", "tag": "c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:34.554857 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:34.555508 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-403021a2-19b1-45dd-8bc5-5a37eb6b350c req-b7f59372-23ef-456e-a157-8b2e3c04350e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:34.555956 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-403021a2-19b1-45dd-8bc5-5a37eb6b350c req-b7f59372-23ef-456e-a157-8b2e3c04350e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:34.556380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:34.557201 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:34.557655 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:34.568626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-403021a2-19b1-45dd-8bc5-5a37eb6b350c req-b7f59372-23ef-456e-a157-8b2e3c04350e service nova] Creating event network-changed:c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c for instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 on hv-cinder-84112 May 09 18:36:34.573728 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-403021a2-19b1-45dd-8bc5-5a37eb6b350c req-b7f59372-23ef-456e-a157-8b2e3c04350e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032073 May 09 18:36:34.574827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 390/790] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:34.586328 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:34.687972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c826bc0e-9128-4d8c-99b6-9fe690abcf94 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 204 len: 0 microversion: 2.1 time: 0.151921 May 09 18:36:34.688910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 401/791] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:34 2022] DELETE /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:34.698440 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:34.699478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:34.705572 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:34.706108 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:34.706997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:34.707669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:34.853859 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:34.861381 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ff4e711a-4853-4892-ae53-9151ef5e9d3e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.168068 May 09 18:36:34.863209 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 391/792] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:34 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:35.018875 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:35.020167 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:35.030207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:35.030674 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:35.032006 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:35.032463 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:35.047139 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] HTTP exception thrown: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Request method failure captured: May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 HTTP/1.1 May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2gsEqVj7Qu4noNTft0UonuomMv88J41HEMVPVdnUH3VHbHyh3I4N3c5XDRnRlPQ7OWqxBb-lkfXXQlQ1lRnXG7OxzBp31fSrKcXjDTu6PqCPCi32vcEL36s8DJPeI5XQGaNNjsNKd9LuWZ3ayFuCcGlTnSPxppe8H5hqyyqJuXeqs May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:35.048862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78039fb4f0bd454b8aea3db748343263"}]}] May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 90fdc96d6e6649a498bb3a8659fcc030 May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:35.050546 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'ff614ce6-f3fe-49aa-97f6-a7c309da1953'} May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:35.051620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:35.053161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:35.054573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Returning 404 to user: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:35.054573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d691308c-8ff7-4a82-b436-41fd923d36dd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 404 len: 111 microversion: 2.1 time: 0.036131 May 09 18:36:35.059436 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a7f92b69-ecd2-4271-b791-f7e86b31931d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '.version_select at 0x7f3f7e6518b0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:35.065937 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 402/793] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:35 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:35.077665 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a7f92b69-ecd2-4271-b791-f7e86b31931d tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385940186" status: 202 len: 0 microversion: 2.1 time: 0.021946 May 09 18:36:35.078434 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 392/794] 10.222.0.25 () {58 vars in 1220 bytes} [Mon May 9 18:36:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385940186 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:35.880739 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:35.882476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:35.892829 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:35.894021 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:35.894873 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:35.895381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:36.235110 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:36.243616 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-08294df6-3833-46ae-acd8-86595c5a7e41 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1567 microversion: 2.1 time: 0.367566 May 09 18:36:36.253509 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 403/795] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:35 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:37.174992 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-e628f860-bf79-41d9-b793-6f546ccb08b0 req-f98f21d3-2603-4724-ba92-60ba2654e5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8243cbea-6bde-4ac9-8f5a-53ec888ed813", "name": "network-vif-deleted", "tag": "c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:36:37.208049 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-e628f860-bf79-41d9-b793-6f546ccb08b0 req-f98f21d3-2603-4724-ba92-60ba2654e5e5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:37.208896 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-e628f860-bf79-41d9-b793-6f546ccb08b0 req-f98f21d3-2603-4724-ba92-60ba2654e5e5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:37.238090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-e628f860-bf79-41d9-b793-6f546ccb08b0 req-f98f21d3-2603-4724-ba92-60ba2654e5e5 service nova] Creating event network-vif-deleted:c2b2da4a-b8aa-4699-a6d8-eb3599ddac7c for instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 on hv-cinder-84112 May 09 18:36:37.244212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-e628f860-bf79-41d9-b793-6f546ccb08b0 req-f98f21d3-2603-4724-ba92-60ba2654e5e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074150 May 09 18:36:37.245333 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 393/796] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:36:37.260814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:37.261448 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:37.270531 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:37.270997 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:37.271814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:37.273737 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:37.341516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:37.349160 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5f503a80-7512-4ea6-950c-611ff8e1cafe tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1218 microversion: 2.1 time: 0.092155 May 09 18:36:37.349758 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 404/797] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:37 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:38.382090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:38.382822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:38.392103 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:38.392694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:38.393615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:38.394614 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:38.434502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:38.435057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:38.435618 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lazy-loading 'fault' on Instance uuid 8243cbea-6bde-4ac9-8f5a-53ec888ed813 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:38.483956 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96dcd82937834f89889c43a1fefc1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e0a23a3414fca84248553e4f85005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:38.490879 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b3b339b5-20c5-4bf6-99db-e21a922542bf tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 200 len: 1177 microversion: 2.1 time: 0.127596 May 09 18:36:38.491488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 394/798] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:38 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 1177 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:38.559657 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:38.560162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:38.566445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:38.566913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:38.567731 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:38.568180 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:38.581706 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] HTTP exception thrown: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Request method failure captured: May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 HTTP/1.1 May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2gsEqVj7Qu4noNTft0UonuomMv88J41HEMVPVdnUH3VHbHyh3I4N3c5XDRnRlPQ7OWqxBb-lkfXXQlQ1lRnXG7OxzBp31fSrKcXjDTu6PqCPCi32vcEL36s8DJPeI5XQGaNNjsNKd9LuWZ3ayFuCcGlTnSPxppe8H5hqyyqJuXeqs May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:38.583312 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78039fb4f0bd454b8aea3db748343263"}]}] May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 90fdc96d6e6649a498bb3a8659fcc030 May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.585390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'ff614ce6-f3fe-49aa-97f6-a7c309da1953'} May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:38.586236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.587614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:38.589287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Returning 404 to user: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:38.589287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cb362203-1ad6-47d1-83fd-e356bd3fdf37 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 404 len: 111 microversion: 2.1 time: 0.028855 May 09 18:36:38.589287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 405/799] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:38 2022] DELETE /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:38.593724 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:38.594358 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: ff614ce6-f3fe-49aa-97f6-a7c309da1953] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:38.600451 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:38.600922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:38.601707 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:38.602158 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:38.616331 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] HTTP exception thrown: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Request method failure captured: May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 HTTP/1.1 May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2gsEqVj7Qu4noNTft0UonuomMv88J41HEMVPVdnUH3VHbHyh3I4N3c5XDRnRlPQ7OWqxBb-lkfXXQlQ1lRnXG7OxzBp31fSrKcXjDTu6PqCPCi32vcEL36s8DJPeI5XQGaNNjsNKd9LuWZ3ayFuCcGlTnSPxppe8H5hqyyqJuXeqs May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:36:38.617958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78039fb4f0bd454b8aea3db748343263"}]}] May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 90fdc96d6e6649a498bb3a8659fcc030 May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.619884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'ff614ce6-f3fe-49aa-97f6-a7c309da1953'} May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:38.621369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. May 09 18:36:38.622902 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:38.624261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Returning 404 to user: Instance ff614ce6-f3fe-49aa-97f6-a7c309da1953 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:38.624261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f08674d5-adf3-45d0-887c-5c6aeea57d1b tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953" status: 404 len: 111 microversion: 2.1 time: 0.029500 May 09 18:36:38.624261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 395/800] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:38 2022] GET /compute/v2.1/servers/ff614ce6-f3fe-49aa-97f6-a7c309da1953 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:39.508179 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:39.508803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] [instance: 8243cbea-6bde-4ac9-8f5a-53ec888ed813] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:39.514852 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.515434 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.516123 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.516610 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.529899 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] HTTP exception thrown: Instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 could not be found. May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Request method failure captured: May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 HTTP/1.1 May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV3RUMPJ6-_NlpOaHtMDXhcyNzRoRJkFh5BcV8u4I7l3NfH6w-xB6bzGNxPeA7uQkzfsyhiDW-a4L-gK6-ICltv0hwm-cqcruDE8HEHTjsjdbTkRE_k6FNmKvYu8VopJRkRmQ6OPJMJYxGBYoNUP2W_UQeorl4jSjo93jXACKLuLtjM May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 9c6e0a23a3414fca84248553e4f85005 May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-TestShelveInstance-1566784394 May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:39.531911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c6e0a23a3414fca84248553e4f85005"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c6e0a23a3414fca84248553e4f85005"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c6e0a23a3414fca84248553e4f85005"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c6e0a23a3414fca84248553e4f85005"}]}] May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-TestShelveInstance-1566784394 May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 9c6e0a23a3414fca84248553e4f85005 May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-TestShelveInstance-1566784394 May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-TestShelveInstance-1566784394-project May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 96dcd82937834f89889c43a1fefc1bff May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-TestShelveInstance-1566784394-project May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 could not be found. May 09 18:36:39.533539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '8243cbea-6bde-4ac9-8f5a-53ec888ed813'} May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 could not be found. May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:39.534428 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 could not be found. May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 could not be found. May 09 18:36:39.536191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.537484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Returning 404 to user: Instance 8243cbea-6bde-4ac9-8f5a-53ec888ed813 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:39.537484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e01ece26-4fa6-475c-a713-262e150cc735 tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813" status: 404 len: 111 microversion: 2.1 time: 0.029539 May 09 18:36:39.537484 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 406/801] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:39 2022] GET /compute/v2.1/servers/8243cbea-6bde-4ac9-8f5a-53ec888ed813 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:39.738775 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-86ee6342-2a56-4b99-a23e-26129885623e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] Calling method '.version_select at 0x7f3f7e631940>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:39.763026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-86ee6342-2a56-4b99-a23e-26129885623e tempest-TestShelveInstance-1566784394 tempest-TestShelveInstance-1566784394-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-35052776" status: 202 len: 0 microversion: 2.1 time: 0.038314 May 09 18:36:39.764526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 396/802] 10.222.0.25 () {58 vars in 1247 bytes} [Mon May 9 18:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-35052776 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:39.798507 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:39.799058 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:39.808435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.808989 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.810376 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.810986 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.829276 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] HTTP exception thrown: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Request method failure captured: May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: DELETE /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 HTTP/1.1 May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV2gsEqVj7Qu4noNTft0UonuomMv88J41HEMVPVdnUH3VHbHyh3I4N3c5XDRnRlPQ7OWqxBb-lkfXXQlQ1lRnXG7OxzBp31fSrKcXjDTu6PqCPCi32vcEL36s8DJPeI5XQGaNNjsNKd9LuWZ3ayFuCcGlTnSPxppe8H5hqyyqJuXeqs May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:36:39.832263 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78039fb4f0bd454b8aea3db748343263"}]}] May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: 90fdc96d6e6649a498bb3a8659fcc030 May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.833849 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'a7a805d4-1420-4adb-a173-724abc1e9915'} May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:39.834773 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.837069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:36:39.839887 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Returning 404 to user: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:39.842244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fbfaaecb-7982-4af1-8c2c-2b225e62e361 tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 404 len: 111 microversion: 2.1 time: 0.051930 May 09 18:36:39.853598 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:39.854786 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] [instance: a7a805d4-1420-4adb-a173-724abc1e9915] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:39.859520 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 407/803] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:39 2022] DELETE /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:39.863853 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.864586 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.865687 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:39.867352 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:39.892497 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] HTTP exception thrown: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Request method failure captured: May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 HTTP/1.1 May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV2gsEqVj7Qu4noNTft0UonuomMv88J41HEMVPVdnUH3VHbHyh3I4N3c5XDRnRlPQ7OWqxBb-lkfXXQlQ1lRnXG7OxzBp31fSrKcXjDTu6PqCPCi32vcEL36s8DJPeI5XQGaNNjsNKd9LuWZ3ayFuCcGlTnSPxppe8H5hqyyqJuXeqs May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:36:39.894536 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78039fb4f0bd454b8aea3db748343263"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78039fb4f0bd454b8aea3db748343263"}]}] May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 78039fb4f0bd454b8aea3db748343263 May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1762280653 May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 90fdc96d6e6649a498bb3a8659fcc030 May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeTestJSON-1762280653-project May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.896152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'a7a805d4-1420-4adb-a173-724abc1e9915'} May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:36:39.897080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. May 09 18:36:39.898590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:36:39.899927 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] Returning 404 to user: Instance a7a805d4-1420-4adb-a173-724abc1e9915 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:36:39.899927 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-67cba122-c7b3-46a0-979f-edec6bb2b7fd tempest-AttachVolumeTestJSON-1762280653 tempest-AttachVolumeTestJSON-1762280653-project] 10.222.0.25 "GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915" status: 404 len: 111 microversion: 2.1 time: 0.048318 May 09 18:36:39.901221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 397/804] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:39 2022] GET /compute/v2.1/servers/a7a805d4-1420-4adb-a173-724abc1e9915 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:36:54.347028 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:54.347600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:54.356879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.357357 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.358172 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:54.358626 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:54.492643 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lazy-loading 'services' on Instance uuid ba0e19b2-bf67-4740-af3f-3c78ae117327 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:36:54.591603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fcaf4183-f461-49f5-9aea-0f0241bc15a5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327/os-volume_attachments/5d94c1cb-cbde-4397-b1ee-e87012be7827" status: 202 len: 0 microversion: 2.1 time: 0.249123 May 09 18:36:54.593194 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 408/805] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:36:54 2022] DELETE /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327/os-volume_attachments/5d94c1cb-cbde-4397-b1ee-e87012be7827 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:36:55.776610 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:55.778151 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:55.784926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:55.795967 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:55.796943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:55.797432 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:55.825384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:55.948407 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-861b2c66-5bde-4b76-b44e-bd343b60b55b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 204 len: 0 microversion: 2.1 time: 0.178192 May 09 18:36:55.950161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 398/806] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:36:55 2022] DELETE /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:36:55.961200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:55.962563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:55.970282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:55.970938 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:55.971958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:55.972622 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.172130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5d2fc9de-48c2-4f74-9c95-6c86983e24cb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:56.173410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5d2fc9de-48c2-4f74-9c95-6c86983e24cb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:56.179421 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d2fc9de-48c2-4f74-9c95-6c86983e24cb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.180099 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d2fc9de-48c2-4f74-9c95-6c86983e24cb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.181039 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d2fc9de-48c2-4f74-9c95-6c86983e24cb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.181640 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d2fc9de-48c2-4f74-9c95-6c86983e24cb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.219572 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5d2fc9de-48c2-4f74-9c95-6c86983e24cb tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051755 May 09 18:36:56.220541 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 399/807] 10.222.0.25 () {60 vars in 1342 bytes} [Mon May 9 18:36:56 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:36:56.311498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:56.312809 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:56.315949 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:56.321599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.322616 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.323633 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.324237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.328515 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5122075b-849f-4e67-8c1b-ee80a9214019 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1513 microversion: 2.1 time: 0.372920 May 09 18:36:56.344014 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 409/808] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:55 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:56.356038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:36:56.462753 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f762609a-e22f-4700-af2c-fe6b4bedb41b tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 204 len: 0 microversion: 2.20 time: 0.160527 May 09 18:36:56.466627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 400/809] 10.222.0.25 () {60 vars in 1279 bytes} [Mon May 9 18:36:56 2022] DELETE /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 18:36:56.476172 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:56.477284 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:56.486879 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.487700 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.489354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:56.491318 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:56.802881 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:56.816650 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:56.818769 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:56.822453 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ab2f92bc-eae5-4984-9df5-a3b8264366c0 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.354175 May 09 18:36:56.824868 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 410/810] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:56 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:36:57.357913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:57.358881 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:57.369223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.369694 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.371249 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.371708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.746212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:57.755700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6a78f79a-e6e0-47fb-a7b4-eeb80109a2a7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1513 microversion: 2.1 time: 0.403986 May 09 18:36:57.765576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 401/811] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:57 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1513 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:57.843030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:57.843994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:57.851296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.851910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:57.852800 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:57.853426 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.144348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:58.167603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:58.171970 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:58.173799 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-66c34faf-7588-4cbf-8725-6a5bba28a332 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.334023 May 09 18:36:58.174571 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 411/812] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:57 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:36:58.774095 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:58.775764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:58.787304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.787777 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:58.788566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:58.794002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:59.192681 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:36:59.193952 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:36:59.206469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:59.210184 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:59.218542 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:36:59.219141 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:36:59.512865 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:59.522565 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8bbca279-8afc-40e5-8807-0a8345dbf068 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1513 microversion: 2.1 time: 0.752366 May 09 18:36:59.538282 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 402/813] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:36:58 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1513 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:36:59.738499 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:59.754740 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:59.758716 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:36:59.763381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-66a3f190-729f-48f8-ac3e-23f73a35ffe3 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1722 microversion: 2.20 time: 0.574167 May 09 18:36:59.764036 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 412/814] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:36:59 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1722 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:37:00.444477 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-1f939b49-44a9-4588-b70f-7c840e87c572 req-df817592-a19a-407b-8961-8e3e6229432e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0e19b2-bf67-4740-af3f-3c78ae117327", "name": "network-vif-deleted", "tag": "34a62ebb-9a32-4a9c-b58d-d0f3d59b133e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:00.463707 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-1f939b49-44a9-4588-b70f-7c840e87c572 req-df817592-a19a-407b-8961-8e3e6229432e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.464752 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-1f939b49-44a9-4588-b70f-7c840e87c572 req-df817592-a19a-407b-8961-8e3e6229432e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.518984 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-1f939b49-44a9-4588-b70f-7c840e87c572 req-df817592-a19a-407b-8961-8e3e6229432e service nova] Creating event network-vif-deleted:34a62ebb-9a32-4a9c-b58d-d0f3d59b133e for instance ba0e19b2-bf67-4740-af3f-3c78ae117327 on hv-cinder-84112 May 09 18:37:00.533517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-1f939b49-44a9-4588-b70f-7c840e87c572 req-df817592-a19a-407b-8961-8e3e6229432e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090234 May 09 18:37:00.535239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 403/815] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:00.555027 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:00.559917 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:00.580586 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.584207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.591269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.594193 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.689609 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.693513 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.695728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lazy-loading 'fault' on Instance uuid ba0e19b2-bf67-4740-af3f-3c78ae117327 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:37:00.782413 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:00.784755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:00.785706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:00.795928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1b7bba45-e6ca-476b-b643-1e74e3a1a304 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 200 len: 1309 microversion: 2.1 time: 0.245136 May 09 18:37:00.796745 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.797164 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 413/816] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:00 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:00.797662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.798693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:00.799475 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:00.924421 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:00.938720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:00.945247 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:00.965443 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-83573399-6d9e-4fc9-bb47-b08dfc257533 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1654 microversion: 2.20 time: 0.181723 May 09 18:37:00.968389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 404/817] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:37:00 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1654 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 18:37:01.804651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a0239ce4-6dae-4b34-a3fe-675e908b1683 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Action: 'create', calling method: .version_select at 0x7f3f839408b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2017172084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtiHYV0djanUqLQjQI/KqNmfeNZS0Ldj6XdAlyrcPkqPRWGWKD358YxfTjzZgl5b4SJHjL1e+s82uUiXEGOMEwIJyA5BhB3C6h1RN6tZ8D9qdlfkghcQo8as3/hGLaW7A=="}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:01.812716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:01.814030 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: ba0e19b2-bf67-4740-af3f-3c78ae117327] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:01.831691 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:01.832568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:01.833621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:01.834298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:01.842292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-a0239ce4-6dae-4b34-a3fe-675e908b1683 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:37:01.850530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] HTTP exception thrown: Instance ba0e19b2-bf67-4740-af3f-3c78ae117327 could not be found. May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Request method failure captured: May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 HTTP/1.1 May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV8LblL2DIYYz_iC1I9oGR4X4uzt_n8zDoIm_uELbQPYLVCoklExwLcFZWOqQZUYY-QfSipRXoYfLTPxWMPEffzYBA9kS80rXETR3u2hYf7IdBIFeS0xxqGLlmU1v1q0GbT1yutE2HCLMipwHiv0CRlInuJPvxkJTPxpksW-jxR8qJM May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 64dd788fefab4eeab253b0f0d341fd2d May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesSnapshotTestJSON-209982285 May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:37:01.852823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64dd788fefab4eeab253b0f0d341fd2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64dd788fefab4eeab253b0f0d341fd2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64dd788fefab4eeab253b0f0d341fd2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64dd788fefab4eeab253b0f0d341fd2d"}]}] May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesSnapshotTestJSON-209982285 May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 64dd788fefab4eeab253b0f0d341fd2d May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-209982285 May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesSnapshotTestJSON-209982285-project May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: b2e8f8cb607649c0836a9c709791fc0e May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesSnapshotTestJSON-209982285-project May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance ba0e19b2-bf67-4740-af3f-3c78ae117327 could not be found. May 09 18:37:01.854498 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'ba0e19b2-bf67-4740-af3f-3c78ae117327'} May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0e19b2-bf67-4740-af3f-3c78ae117327 could not be found. May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:01.855494 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0e19b2-bf67-4740-af3f-3c78ae117327 could not be found. May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0e19b2-bf67-4740-af3f-3c78ae117327 could not be found. May 09 18:37:01.857054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:01.858782 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Returning 404 to user: Instance ba0e19b2-bf67-4740-af3f-3c78ae117327 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:01.858782 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-05ba4682-2ff4-4509-a04a-8dc9ec9d9180 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327" status: 404 len: 111 microversion: 2.1 time: 0.047748 May 09 18:37:01.858782 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 405/818] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:01 2022] GET /compute/v2.1/servers/ba0e19b2-bf67-4740-af3f-3c78ae117327 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:37:01.859516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-a0239ce4-6dae-4b34-a3fe-675e908b1683 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for user d1934a2e2edb4b8a93baac501c9c5c3b and project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:37:01.899759 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a0239ce4-6dae-4b34-a3fe-675e908b1683 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.510991 May 09 18:37:01.900369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 414/819] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:37:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:01.994165 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:01.997882 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:02.013514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.014373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.016091 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.018708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.110481 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.111346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.112058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lazy-loading 'fault' on Instance uuid edd17ee8-9df4-4b0b-b150-574fed351dde {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:37:02.208589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:02.221224 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:02.223669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac32da403af402c8236f46168e81038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127c608e5ebd478282b045739182c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:02.225834 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fced9e72-cb29-48fa-b44a-3a5daaaccb3a tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 200 len: 1370 microversion: 2.20 time: 0.242800 May 09 18:37:02.226511 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 406/820] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:37:01 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 18:37:02.604498 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-045efc1b-7652-4f15-9066-4044084d87a9 req-eaa8c734-bb35-4a25-b516-9c91a1a2eabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd17ee8-9df4-4b0b-b150-574fed351dde", "name": "network-vif-deleted", "tag": "24ac401c-c8b4-41af-97fa-c5c82f0aa6b7"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:02.616343 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-045efc1b-7652-4f15-9066-4044084d87a9 req-eaa8c734-bb35-4a25-b516-9c91a1a2eabd service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:02.617095 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-045efc1b-7652-4f15-9066-4044084d87a9 req-eaa8c734-bb35-4a25-b516-9c91a1a2eabd service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:02.639423 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-045efc1b-7652-4f15-9066-4044084d87a9 req-eaa8c734-bb35-4a25-b516-9c91a1a2eabd service nova] Creating event network-vif-deleted:24ac401c-c8b4-41af-97fa-c5c82f0aa6b7 for instance edd17ee8-9df4-4b0b-b150-574fed351dde on hv-cinder-84112 May 09 18:37:02.644770 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-045efc1b-7652-4f15-9066-4044084d87a9 req-eaa8c734-bb35-4a25-b516-9c91a1a2eabd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046136 May 09 18:37:02.646792 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 415/821] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:03.245884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:03.247927 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:03.261530 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.263311 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.264640 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:03.265345 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:03.288468 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] HTTP exception thrown: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Request method failure captured: May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde HTTP/1.1 May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV3eSqepJM5HWXs3AwBEpmZaYajVAFCMHljS8YRHDQ2dIujb4Fyn6Hr709c_WzUzeQLCORbY7F0_TdgdvZoHGrVZNFVfRBf8JnYhyaa-ZK7NGVfC4hF5hHAG8U9w3wOvkeothpEGEivpURLCXFc2B7l8Vejq4S4NXX5UKlOmbht2Pdk May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:37:03.290703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/127c608e5ebd478282b045739182c41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_127c608e5ebd478282b045739182c41e"}]}] May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: cac32da403af402c8236f46168e81038 May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:03.292355 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'edd17ee8-9df4-4b0b-b150-574fed351dde'} May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:03.293589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:03.294821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:03.297304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Returning 404 to user: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:03.297304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8dc657ee-b56a-48c6-853b-2dc0202742aa tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 404 len: 111 microversion: 2.20 time: 0.050889 May 09 18:37:03.297304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 407/822] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:37:03 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:37:03.301789 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dde051ce-2e16-41a6-9954-ecda3bde1d62 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '.version_select at 0x7f3f83940b80>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:03.320815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dde051ce-2e16-41a6-9954-ecda3bde1d62 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132992640" status: 204 len: 0 microversion: 2.20 time: 0.023127 May 09 18:37:03.323947 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 416/823] 10.222.0.25 () {60 vars in 1261 bytes} [Mon May 9 18:37:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132992640 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 18:37:06.346300 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:06.348345 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:06.356620 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.357086 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:06.358072 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.358528 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:06.373539 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] HTTP exception thrown: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Request method failure captured: May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: DELETE /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde HTTP/1.1 May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV3eSqepJM5HWXs3AwBEpmZaYajVAFCMHljS8YRHDQ2dIujb4Fyn6Hr709c_WzUzeQLCORbY7F0_TdgdvZoHGrVZNFVfRBf8JnYhyaa-ZK7NGVfC4hF5hHAG8U9w3wOvkeothpEGEivpURLCXFc2B7l8Vejq4S4NXX5UKlOmbht2Pdk May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:37:06.375410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/127c608e5ebd478282b045739182c41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_127c608e5ebd478282b045739182c41e"}]}] May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: cac32da403af402c8236f46168e81038 May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.377109 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': 'edd17ee8-9df4-4b0b-b150-574fed351dde'} May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:06.378004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.379476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:06.381862 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Returning 404 to user: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:06.382897 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-256d48e4-40d6-41be-a086-15e71148ee70 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 404 len: 111 microversion: 2.20 time: 0.040620 May 09 18:37:06.383680 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 408/824] 10.222.0.25 () {60 vars in 1279 bytes} [Mon May 9 18:37:06 2022] DELETE /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 09 18:37:06.392271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:06.393277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: edd17ee8-9df4-4b0b-b150-574fed351dde] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:06.402823 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.403494 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:06.404637 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:06.405242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:06.430570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] HTTP exception thrown: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Request method failure captured: May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde HTTP/1.1 May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV3eSqepJM5HWXs3AwBEpmZaYajVAFCMHljS8YRHDQ2dIujb4Fyn6Hr709c_WzUzeQLCORbY7F0_TdgdvZoHGrVZNFVfRBf8JnYhyaa-ZK7NGVfC4hF5hHAG8U9w3wOvkeothpEGEivpURLCXFc2B7l8Vejq4S4NXX5UKlOmbht2Pdk May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:37:06.432831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/127c608e5ebd478282b045739182c41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_127c608e5ebd478282b045739182c41e"}]}] May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: cac32da403af402c8236f46168e81038 May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.434298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'edd17ee8-9df4-4b0b-b150-574fed351dde'} May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:06.435063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. May 09 18:37:06.436532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:06.437911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Returning 404 to user: Instance edd17ee8-9df4-4b0b-b150-574fed351dde could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:06.437911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a7c97c12-1f01-4add-9168-7235bf1842dc tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde" status: 404 len: 111 microversion: 2.20 time: 0.046363 May 09 18:37:06.437911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 417/825] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:37:06 2022] GET /compute/v2.1/servers/edd17ee8-9df4-4b0b-b150-574fed351dde => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 09 18:37:07.587294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:07.587976 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:07.594142 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:07.594696 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.595440 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:07.595919 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.609278 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] HTTP exception thrown: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Request method failure captured: May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: DELETE /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb HTTP/1.1 May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV3eSqepJM5HWXs3AwBEpmZaYajVAFCMHljS8YRHDQ2dIujb4Fyn6Hr709c_WzUzeQLCORbY7F0_TdgdvZoHGrVZNFVfRBf8JnYhyaa-ZK7NGVfC4hF5hHAG8U9w3wOvkeothpEGEivpURLCXFc2B7l8Vejq4S4NXX5UKlOmbht2Pdk May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:37:07.611026 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/127c608e5ebd478282b045739182c41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_127c608e5ebd478282b045739182c41e"}]}] May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: cac32da403af402c8236f46168e81038 May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.612697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '02b5c8d4-23e0-426a-806c-d472fcd826fb'} May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:07.613611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.615411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:37:07.616874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Returning 404 to user: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:07.616874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7e5f11cd-b44e-4e34-8866-7c1d7f2a69b7 tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 404 len: 111 microversion: 2.20 time: 0.031693 May 09 18:37:07.616874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 409/826] 10.222.0.25 () {60 vars in 1279 bytes} [Mon May 9 18:37:07 2022] DELETE /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 18:37:07.623269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:07.623900 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] [instance: 02b5c8d4-23e0-426a-806c-d472fcd826fb] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:07.630637 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:07.631097 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.631901 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:07.632349 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:07.645524 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] HTTP exception thrown: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Request method failure captured: May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb HTTP/1.1 May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV3eSqepJM5HWXs3AwBEpmZaYajVAFCMHljS8YRHDQ2dIujb4Fyn6Hr709c_WzUzeQLCORbY7F0_TdgdvZoHGrVZNFVfRBf8JnYhyaa-ZK7NGVfC4hF5hHAG8U9w3wOvkeothpEGEivpURLCXFc2B7l8Vejq4S4NXX5UKlOmbht2Pdk May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Openstack-Nova-Api-Version: 2.20 May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:37:07.647702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/127c608e5ebd478282b045739182c41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/127c608e5ebd478282b045739182c41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_127c608e5ebd478282b045739182c41e"}]}] May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 127c608e5ebd478282b045739182c41e May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-67833414 May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: cac32da403af402c8236f46168e81038 May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-67833414-project May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.649296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '02b5c8d4-23e0-426a-806c-d472fcd826fb'} May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:07.653669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. May 09 18:37:07.655389 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:07.656694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] Returning 404 to user: Instance 02b5c8d4-23e0-426a-806c-d472fcd826fb could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:07.656694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ebabafd0-4ea8-473e-927d-8ce922da0dcf tempest-AttachVolumeShelveTestJSON-67833414 tempest-AttachVolumeShelveTestJSON-67833414-project] 10.222.0.25 "GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb" status: 404 len: 111 microversion: 2.20 time: 0.029981 May 09 18:37:07.656694 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 418/827] 10.222.0.25 () {60 vars in 1276 bytes} [Mon May 9 18:37:07 2022] GET /compute/v2.1/servers/02b5c8d4-23e0-426a-806c-d472fcd826fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 09 18:37:10.090394 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1210459606", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "networks": [{"uuid": "b57d7f0b-92ae-439d-91c0-77be8f7f50c8"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:10.151268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] validate_networks() for [('b57d7f0b-92ae-439d-91c0-77be8f7f50c8', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:37:10.637662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:37:10.638117 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:37:10.638628 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:37:10.639051 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:37:10.639506 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:37:10.649716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.650185 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:10.650985 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:10.651789 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:10.679107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Getting quotas for project 64dd788fefab4eeab253b0f0d341fd2d. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:37:10.685275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Getting quotas for user b2e8f8cb607649c0836a9c709791fc0e and project 64dd788fefab4eeab253b0f0d341fd2d. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:37:10.701672 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:37:10.706437 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:37:10.766484 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fd344c73-2178-4c1a-a063-a4fe07b7dce0 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680660 May 09 18:37:10.767472 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 410/828] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 18:37:10.778670 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1d2dbce8-a9cf-4778-b155-3532ef82d98c tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:10.780093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1d2dbce8-a9cf-4778-b155-3532ef82d98c tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:10.912184 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1d2dbce8-a9cf-4778-b155-3532ef82d98c tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:10.928356 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1d2dbce8-a9cf-4778-b155-3532ef82d98c tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1219 microversion: 2.1 time: 0.154634 May 09 18:37:10.928941 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 419/829] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:10 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:11.946835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:11.948153 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:11.960309 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:11.960786 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:11.963892 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:11.964370 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:12.086312 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:12.094256 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b822492c-aa67-42d3-b26e-c15fb11034e5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1279 microversion: 2.1 time: 0.153241 May 09 18:37:12.098173 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 411/830] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:11 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:13.121100 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:13.122552 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:13.133234 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:13.134155 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:13.135296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:13.136199 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:13.361401 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:13.372288 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-db47b497-2a2b-452f-b4a8-f72e1706179e tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1319 microversion: 2.1 time: 0.259298 May 09 18:37:13.380860 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 420/831] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:13 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:13.703217 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-ae66938a-ab43-4245-b276-9b9568ec68ed req-b4230c78-5526-496e-9b3c-c741692147ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b7f9f6-3920-4dc1-b126-e846eab217c5", "tag": "5e1ae9aa-0a11-462a-821e-04380f9105c2"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:13.719737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-ae66938a-ab43-4245-b276-9b9568ec68ed req-b4230c78-5526-496e-9b3c-c741692147ed service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:13.720507 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-ae66938a-ab43-4245-b276-9b9568ec68ed req-b4230c78-5526-496e-9b3c-c741692147ed service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:13.740280 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-ae66938a-ab43-4245-b276-9b9568ec68ed req-b4230c78-5526-496e-9b3c-c741692147ed service nova] Creating event network-changed:5e1ae9aa-0a11-462a-821e-04380f9105c2 for instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 on hv-cinder-84112 May 09 18:37:13.745986 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-ae66938a-ab43-4245-b276-9b9568ec68ed req-b4230c78-5526-496e-9b3c-c741692147ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049596 May 09 18:37:13.746661 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 412/832] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:14.392429 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:14.394005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:14.401410 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:14.401862 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:14.402643 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:14.403082 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:14.622223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:14.629632 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0e0c37e3-77c2-4284-b8c7-5fcf566b7416 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1319 microversion: 2.1 time: 0.241077 May 09 18:37:14.630727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 421/833] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:14 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:15.648196 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:15.648924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:15.655025 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:15.655521 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:15.656321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:15.656770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:15.789007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:15.796344 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-100cbdb1-e378-467f-85b6-cab91359dde5 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1319 microversion: 2.1 time: 0.152902 May 09 18:37:15.796900 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 413/834] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:15 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:16.364528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-767555970", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "networks": [{"uuid": "59036ca0-bb3f-4d2c-8a69-3aa429c09c41"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:16.415067 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] validate_networks() for [('59036ca0-bb3f-4d2c-8a69-3aa429c09c41', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:37:16.812118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:16.813341 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:16.820378 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:16.821080 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:16.822037 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:16.822653 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:16.850523 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:37:16.850980 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:37:16.851513 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:37:16.851965 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:37:16.852388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:37:16.861281 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:16.861741 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:16.862561 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:16.863012 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:16.880286 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Getting quotas for project 05197c0440624fce9090b97e6826d516. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:37:16.884191 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Getting quotas for user cdb5118d48d0412f8536c47b9dffb88c and project 05197c0440624fce9090b97e6826d516. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:37:16.894784 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:37:16.897653 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:37:16.941977 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f8179f19-b930-4a9b-b151-74622bf1f529 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581708 May 09 18:37:16.947377 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 422/835] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:37:16.952464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b97edd8c-91d3-4620-ab27-7fdb756f84bb tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:16.953202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b97edd8c-91d3-4620-ab27-7fdb756f84bb tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:16.972886 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:16.990091 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d6bf2380-db91-4150-b805-aca259b07d14 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1319 microversion: 2.1 time: 0.172858 May 09 18:37:16.991802 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 414/836] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:16 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:17.013364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b97edd8c-91d3-4620-ab27-7fdb756f84bb tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:17.020985 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b97edd8c-91d3-4620-ab27-7fdb756f84bb tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1213 microversion: 2.1 time: 0.071802 May 09 18:37:17.021774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 423/837] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:16 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:18.008706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:18.009374 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:18.019613 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:18.020640 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:18.021535 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:18.022041 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:18.038571 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:18.039486 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:18.045365 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:18.046243 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:18.047045 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:18.047551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:18.179003 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:18.186404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8d642120-9bd1-4e92-92db-d4c068aab810 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1283 microversion: 2.1 time: 0.152419 May 09 18:37:18.188109 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 424/838] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:18 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:18.281030 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:18.289513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f063f8be-716f-4201-b285-a9984c38b09b tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1319 microversion: 2.1 time: 0.286121 May 09 18:37:18.296506 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 415/839] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:18 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:19.130890 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-1381a19e-102f-4491-94c7-628432409b7c req-b322afa4-ec9c-40ce-9602-bd0a83d0ce2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b7f9f6-3920-4dc1-b126-e846eab217c5", "name": "network-vif-plugged", "status": "completed", "tag": "5e1ae9aa-0a11-462a-821e-04380f9105c2"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:19.140147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1381a19e-102f-4491-94c7-628432409b7c req-b322afa4-ec9c-40ce-9602-bd0a83d0ce2b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.140895 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1381a19e-102f-4491-94c7-628432409b7c req-b322afa4-ec9c-40ce-9602-bd0a83d0ce2b service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.154418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-1381a19e-102f-4491-94c7-628432409b7c req-b322afa4-ec9c-40ce-9602-bd0a83d0ce2b service nova] Creating event network-vif-plugged:5e1ae9aa-0a11-462a-821e-04380f9105c2 for instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 on hv-cinder-84112 May 09 18:37:19.160279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-1381a19e-102f-4491-94c7-628432409b7c req-b322afa4-ec9c-40ce-9602-bd0a83d0ce2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034350 May 09 18:37:19.162399 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 425/840] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:19.205471 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:19.206183 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:19.214278 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.215476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.216373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.216895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.307717 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:19.308548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:19.314777 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.315282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.316073 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.316513 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.554254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:19.569436 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-63b976ed-6cc8-40fb-8dc6-3f1d3f38b355 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.368617 May 09 18:37:19.570032 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 416/841] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:19 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:19.584732 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-9c945d86-3d58-4752-b08f-bb3d4d20109d req-382d7360-c705-48f1-bcb2-d2efd1101e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab4070c3-ee30-436e-b30c-77e20c7c0f7f", "tag": "6354c5f3-b5eb-4f1d-83d8-e74c5187ac65"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:19.592526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-9c945d86-3d58-4752-b08f-bb3d4d20109d req-382d7360-c705-48f1-bcb2-d2efd1101e24 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:19.592989 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-9c945d86-3d58-4752-b08f-bb3d4d20109d req-382d7360-c705-48f1-bcb2-d2efd1101e24 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:19.603423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-9c945d86-3d58-4752-b08f-bb3d4d20109d req-382d7360-c705-48f1-bcb2-d2efd1101e24 service nova] Creating event network-changed:6354c5f3-b5eb-4f1d-83d8-e74c5187ac65 for instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f on hv-cinder-84112 May 09 18:37:19.608621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-9c945d86-3d58-4752-b08f-bb3d4d20109d req-382d7360-c705-48f1-bcb2-d2efd1101e24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028023 May 09 18:37:19.609250 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 417/842] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:19.649777 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:19.657957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4c65e135-9a68-4cd8-95d6-313ad3a5d3ac tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1319 microversion: 2.1 time: 0.355161 May 09 18:37:19.658530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 426/843] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:19 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:20.588107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:20.589460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:20.596124 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:20.596579 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:20.597545 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:20.598892 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:20.675857 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:20.676534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:20.683088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:20.683683 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:20.684735 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:20.685244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:20.810305 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:20.819579 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3449dcd2-4543-47f7-981d-ab7405a26eb9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.236050 May 09 18:37:20.820340 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 418/844] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:20 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:20.860751 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:20.868549 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7a60235f-1991-4756-b561-9bbb09320ae7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1319 microversion: 2.1 time: 0.196476 May 09 18:37:20.869151 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 427/845] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:20 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:21.837062 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:21.837716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:21.843939 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:21.844393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:21.845190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:21.845636 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:21.886259 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:21.887027 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:21.894252 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:21.894856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:21.896619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:21.897199 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:22.036015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:22.047527 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2c58aabb-afda-4c2e-b53f-44e94829b6ff tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.214881 May 09 18:37:22.049967 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 419/846] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:21 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:22.060366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:22.069479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-146b040f-4379-4f99-ba49-1cc698ce3c5a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1507 microversion: 2.1 time: 0.187081 May 09 18:37:22.070205 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 428/847] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:21 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:22.076993 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1456271499", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2017172084", "security_groups": [{"name": "tempest-secgroup-smoke-531814017"}], "block_device_mapping_v2": [{"uuid": "f90c3b50-2609-469d-b8b3-4f570d49dccb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d96723e-3ac9-459f-80bb-639b9429b963"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:22.086298 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6d7d4969-8829-4f06-9ea7-5777cbd65366 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "667189de-7a54-44a7-b7ce-10ec37dedd74", "device": "/dev/sdb"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:22.087453 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6d7d4969-8829-4f06-9ea7-5777cbd65366 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:22.093707 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d7d4969-8829-4f06-9ea7-5777cbd65366 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:22.094412 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d7d4969-8829-4f06-9ea7-5777cbd65366 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:22.095580 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d7d4969-8829-4f06-9ea7-5777cbd65366 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:22.096097 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d7d4969-8829-4f06-9ea7-5777cbd65366 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:22.190495 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] validate_networks() for [('8d96723e-3ac9-459f-80bb-639b9429b963', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:37:22.378292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6d7d4969-8829-4f06-9ea7-5777cbd65366 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "POST /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296485 May 09 18:37:22.379278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 429/848] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:37:22 2022] POST /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:37:22.836812 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:37:22.837303 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:37:22.837830 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:37:22.838316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:37:22.838803 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:37:22.850670 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:22.851141 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:22.851991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:22.852441 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:22.868988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:37:22.873332 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for user d1934a2e2edb4b8a93baac501c9c5c3b and project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:37:22.930622 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:37:22.932814 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f90c3b50-2609-469d-b8b3-4f570d49dccb',volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:37:23.057039 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a1373f11-7ee7-442b-877a-81d2a4434177 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.984460 May 09 18:37:23.057959 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 420/849] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:37:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:37:23.066403 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:23.068111 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9c8158a9-b318-4c52-b1ab-87a438c78181 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:23.068703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:23.068865 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9c8158a9-b318-4c52-b1ab-87a438c78181 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:23.077265 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:23.077869 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:23.078568 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:23.079089 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:23.135031 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9c8158a9-b318-4c52-b1ab-87a438c78181 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:23.142184 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9c8158a9-b318-4c52-b1ab-87a438c78181 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1095 microversion: 2.1 time: 0.078176 May 09 18:37:23.142924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 421/850] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:23 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:23.229517 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:23.237667 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-eb27249e-d5d3-45b4-a67a-df708ed586e5 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.176419 May 09 18:37:23.238247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 430/851] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:23 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:24.159539 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:24.160516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:24.167889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:24.168353 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:24.169144 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:24.169589 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:24.250456 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:24.258273 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e93aaca0-5e57-43dc-bffb-c8d9e493159a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1211 microversion: 2.1 time: 0.102937 May 09 18:37:24.259101 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 422/852] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:24 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:24.262348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:24.262983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:24.269286 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:24.269748 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:24.271137 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:24.271594 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:24.450252 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:24.459123 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8743e6ed-2f3a-4302-93e1-1fc06bd1dcf2 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.201640 May 09 18:37:24.459748 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 431/853] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:24 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:25.276946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:25.278228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:25.284883 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.285350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.286960 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.287438 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.480229 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:25.481551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:25.481967 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:25.490133 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.490597 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.491417 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.491722 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c96ce539-4728-4264-b59c-1c3e4444a11b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1278 microversion: 2.1 time: 0.219719 May 09 18:37:25.491863 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.492430 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 423/854] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:25 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:25.656619 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-7544e571-1b6c-469d-b204-94d5c8436a17 req-9bb5d95c-244b-4ad3-acb1-392ac24786c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac89178-8a4d-4e19-949a-c5972218cb08", "tag": "c19bbb2b-1768-4b80-966b-c5c78d575c4a"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:25.673972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-7544e571-1b6c-469d-b204-94d5c8436a17 req-9bb5d95c-244b-4ad3-acb1-392ac24786c6 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:25.674437 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-7544e571-1b6c-469d-b204-94d5c8436a17 req-9bb5d95c-244b-4ad3-acb1-392ac24786c6 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:25.699628 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-7544e571-1b6c-469d-b204-94d5c8436a17 req-9bb5d95c-244b-4ad3-acb1-392ac24786c6 service nova] Creating event network-changed:c19bbb2b-1768-4b80-966b-c5c78d575c4a for instance 1ac89178-8a4d-4e19-949a-c5972218cb08 on hv-cinder-84112 May 09 18:37:25.706688 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-7544e571-1b6c-469d-b204-94d5c8436a17 req-9bb5d95c-244b-4ad3-acb1-392ac24786c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054038 May 09 18:37:25.709514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 424/855] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:37:25.728537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:25.742235 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-58fc88a3-8f89-4729-a515-4b831f249c6d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.266543 May 09 18:37:25.743492 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 432/856] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:25 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:26.509737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:26.510452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:26.516439 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:26.516909 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:26.517689 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:26.518146 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:26.715461 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:26.724030 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-02cac528-6cf4-4bb6-b3f4-a3396feddfb0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1278 microversion: 2.1 time: 0.218332 May 09 18:37:26.724603 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 425/857] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:26 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:26.760338 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:26.760966 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:26.767278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:26.767744 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:26.768722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:26.769247 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:26.891995 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:26.899607 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-952f3b77-71fc-42f6-b307-af577c9b06f0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.143036 May 09 18:37:26.900178 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 433/858] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:26 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:27.155801 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-ba894608-54dc-4106-a7f4-7d73b0c99614 req-2fcd6516-9d91-404b-8da2-1bfa335ed945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4070c3-ee30-436e-b30c-77e20c7c0f7f", "name": "network-vif-plugged", "status": "completed", "tag": "6354c5f3-b5eb-4f1d-83d8-e74c5187ac65"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:27.164314 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-ba894608-54dc-4106-a7f4-7d73b0c99614 req-2fcd6516-9d91-404b-8da2-1bfa335ed945 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:27.165356 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-ba894608-54dc-4106-a7f4-7d73b0c99614 req-2fcd6516-9d91-404b-8da2-1bfa335ed945 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:27.176207 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-ba894608-54dc-4106-a7f4-7d73b0c99614 req-2fcd6516-9d91-404b-8da2-1bfa335ed945 service nova] Creating event network-vif-plugged:6354c5f3-b5eb-4f1d-83d8-e74c5187ac65 for instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f on hv-cinder-84112 May 09 18:37:27.181043 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-ba894608-54dc-4106-a7f4-7d73b0c99614 req-2fcd6516-9d91-404b-8da2-1bfa335ed945 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028908 May 09 18:37:27.181823 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 426/859] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:37:27.746797 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:27.746797 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:27.747684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:27.748146 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:27.748916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:27.749360 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:27.878697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:27.885909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6843781c-ce79-434c-aa4a-ba4864f500b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1278 microversion: 2.1 time: 0.149446 May 09 18:37:27.886479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 434/860] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:27 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:27.916306 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:27.916946 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:27.923458 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:27.923927 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:27.924702 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:27.925154 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:28.053418 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:28.060940 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0e70cfc1-0708-4656-837c-35ccee1bc778 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1313 microversion: 2.1 time: 0.148776 May 09 18:37:28.061540 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 427/861] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:27 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:28.902518 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:28.903149 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:28.909590 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:28.910048 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:28.911495 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:28.911913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:29.078478 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:29.079320 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:29.086214 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:29.086625 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:29.087434 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:29.087874 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:29.260685 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:29.268276 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cef299a6-5f7d-4cec-9dbb-4164b44f1b35 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1278 microversion: 2.1 time: 0.369497 May 09 18:37:29.268840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 435/862] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:28 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1278 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:29.285115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:29.292573 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dedbb3f5-e580-4ed7-b539-142c870efa35 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1496 microversion: 2.1 time: 0.218725 May 09 18:37:29.293357 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 428/863] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:29 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1496 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:29.778388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:29.778837 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:29.784420 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:29.784881 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:29.785732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:29.786688 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:29.811537 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:37:29.900487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9cf870d6-05f5-498a-8645-d1432eae0b07 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 204 len: 0 microversion: 2.1 time: 0.125213 May 09 18:37:29.901838 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 436/864] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:37:29 2022] DELETE /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:37:29.912008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:29.912990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:29.919272 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:29.920068 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:29.921253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:29.921738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:30.130831 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:30.138734 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-86b16cd3-cace-498b-b9bb-578d7e168dbf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1502 microversion: 2.1 time: 0.232133 May 09 18:37:30.139429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 429/865] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:29 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:30.286402 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:30.288856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:30.296019 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:30.296600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:30.297503 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:30.298067 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:30.429283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:30.437133 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ce89b211-ad43-42b3-8952-d2034215df28 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1278 microversion: 2.1 time: 0.155041 May 09 18:37:30.437808 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 437/866] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:30 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:31.157136 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:31.157764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:31.164808 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:31.165275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:31.166059 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:31.166510 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:31.302905 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:31.310782 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f9adb363-6750-4431-bd6d-a9aacbbb22d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1502 microversion: 2.1 time: 0.157656 May 09 18:37:31.311384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 430/867] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:31 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:31.454673 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:31.455336 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:31.461531 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:31.461994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:31.462808 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:31.463279 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:31.596086 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:31.603994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b288e84b-2764-48fe-928a-f96c7bbef125 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1278 microversion: 2.1 time: 0.153048 May 09 18:37:31.604556 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 438/868] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:31 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:32.328049 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:32.328713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:32.335660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:32.336149 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:32.336898 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:32.337344 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:32.461383 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:32.468716 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-78f181d9-7cdd-42cf-8374-a65fa329b183 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1502 microversion: 2.1 time: 0.144538 May 09 18:37:32.469289 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 431/869] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:32 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1502 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:32.620986 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:32.621541 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:32.628035 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:32.628502 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:32.629903 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:32.630371 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:32.760192 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:32.767393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b8585e82-5fe4-4489-9732-942c31f6be29 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1278 microversion: 2.1 time: 0.150595 May 09 18:37:32.767955 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 439/870] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:32 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:33.485063 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:33.485712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:33.492389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:33.492845 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:33.493605 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:33.494046 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:33.617721 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:33.625244 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-eaa49fab-5f64-40f1-9c88-88bfc1996279 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1502 microversion: 2.1 time: 0.144012 May 09 18:37:33.625812 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 432/871] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:33 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1502 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:33.784106 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:33.784656 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:33.791472 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:33.791935 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:33.792743 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:33.793192 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:34.006069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:34.013945 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a84a6c4c-0c12-4405-82fa-7b3534dc20b5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.233734 May 09 18:37:34.023689 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 440/872] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:33 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:34.292059 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-c86e530e-f77a-42aa-b378-f50be30a238b req-95469145-020c-4edc-862b-adfe2ec65705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4070c3-ee30-436e-b30c-77e20c7c0f7f", "name": "network-vif-deleted", "tag": "6354c5f3-b5eb-4f1d-83d8-e74c5187ac65"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:34.303346 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-c86e530e-f77a-42aa-b378-f50be30a238b req-95469145-020c-4edc-862b-adfe2ec65705 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:34.303797 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-c86e530e-f77a-42aa-b378-f50be30a238b req-95469145-020c-4edc-862b-adfe2ec65705 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:34.316499 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-c86e530e-f77a-42aa-b378-f50be30a238b req-95469145-020c-4edc-862b-adfe2ec65705 service nova] Creating event network-vif-deleted:6354c5f3-b5eb-4f1d-83d8-e74c5187ac65 for instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f on hv-cinder-84112 May 09 18:37:34.324003 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-c86e530e-f77a-42aa-b378-f50be30a238b req-95469145-020c-4edc-862b-adfe2ec65705 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037295 May 09 18:37:34.325403 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 433/873] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:34.642599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:34.643145 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:34.649653 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:34.650113 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:34.650896 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:34.651379 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:34.683798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:34.684324 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:34.684981 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lazy-loading 'fault' on Instance uuid ab4070c3-ee30-436e-b30c-77e20c7c0f7f {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:37:34.727096 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:34.735994 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e6891d49-1e0d-48cb-839f-af51ec1c94a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 200 len: 1303 microversion: 2.1 time: 0.097256 May 09 18:37:34.736727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 441/874] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:34 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:35.031738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:35.032442 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:35.038847 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:35.039354 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:35.040132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:35.040579 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:35.175669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:35.183615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-37864afe-d22d-42ab-86c6-80f3234d262a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.156220 May 09 18:37:35.184175 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 434/875] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:35 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:35.753814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:35.754440 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: ab4070c3-ee30-436e-b30c-77e20c7c0f7f] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:35.760736 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:35.761163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:35.761938 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:35.762379 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:35.776173 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] HTTP exception thrown: Instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f could not be found. May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Request method failure captured: May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f HTTP/1.1 May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV9aQ7mL-ZmZqm7GtCXTxjTEQDD96zPebDk2A_XS10PFxnZnRw3BM_1JyEbKj1k1bj8pM3PDyThSh5RMHstC1WzcvgW_fZlxlswCjyJ6kz5kf8CsX-I0Pc9Mf3lVFR1xjn4vArz7rqMLYMb83hB6T3vnX955zhDsNkvN710AcaOGXW4 May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 05197c0440624fce9090b97e6826d516 May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-VolumesActionsTest-1174180819 May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:37:35.777814 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05197c0440624fce9090b97e6826d516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05197c0440624fce9090b97e6826d516"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05197c0440624fce9090b97e6826d516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05197c0440624fce9090b97e6826d516"}]}] May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-VolumesActionsTest-1174180819 May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 05197c0440624fce9090b97e6826d516 May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-VolumesActionsTest-1174180819 May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-VolumesActionsTest-1174180819-project May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: cdb5118d48d0412f8536c47b9dffb88c May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-VolumesActionsTest-1174180819-project May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f could not be found. May 09 18:37:35.779530 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'ab4070c3-ee30-436e-b30c-77e20c7c0f7f'} May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f could not be found. May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:35.780493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f could not be found. May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f could not be found. May 09 18:37:35.781798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:35.782925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Returning 404 to user: Instance ab4070c3-ee30-436e-b30c-77e20c7c0f7f could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:35.782925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d127d10d-0e4f-49c5-96e2-22e35b64e021 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f" status: 404 len: 111 microversion: 2.1 time: 0.029463 May 09 18:37:35.782925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 442/876] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:35 2022] GET /compute/v2.1/servers/ab4070c3-ee30-436e-b30c-77e20c7c0f7f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:37:35.873423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1715666888", "imageRef": "4ea9cf17-c587-4d47-9eee-016c25d59d99", "flavorRef": "452", "networks": [{"uuid": "59036ca0-bb3f-4d2c-8a69-3aa429c09c41"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:35.922760 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] validate_networks() for [('59036ca0-bb3f-4d2c-8a69-3aa429c09c41', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:37:36.200130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:36.200805 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:36.206463 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:36.206918 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:36.207732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:36.208176 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:36.276744 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:37:36.277239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:37:36.277711 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:37:36.278212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:37:36.278735 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:37:36.288522 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:36.289061 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:36.289936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:36.290449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:36.307759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Getting quotas for project 05197c0440624fce9090b97e6826d516. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:37:36.311692 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Getting quotas for user cdb5118d48d0412f8536c47b9dffb88c and project 05197c0440624fce9090b97e6826d516. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:37:36.322274 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:37:36.324559 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ea9cf17-c587-4d47-9eee-016c25d59d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:37:36.345500 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:36.353573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-58f688e6-6616-4581-9a08-fb62abbaebd1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.157207 May 09 18:37:36.354317 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 443/877] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:36 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:36.371850 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-44fd576c-8987-410a-88e7-a91ffd61c338 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502378 May 09 18:37:36.372497 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 435/878] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:37:36.382207 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0e66a83e-afd3-489b-9fae-4f3c64a1d5d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:36.382841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0e66a83e-afd3-489b-9fae-4f3c64a1d5d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:36.435692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0e66a83e-afd3-489b-9fae-4f3c64a1d5d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:36.442690 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0e66a83e-afd3-489b-9fae-4f3c64a1d5d7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1214 microversion: 2.1 time: 0.064131 May 09 18:37:36.443292 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 444/879] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:36 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:37.371188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:37.371964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:37.380998 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:37.381454 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:37.382229 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:37.382672 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:37.459938 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:37.460668 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:37.467803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:37.468549 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:37.469528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:37.470122 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:37.544695 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:37.553898 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-945d54df-fa8d-44cc-92fb-f4da50827e1d tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1210 microversion: 2.1 time: 0.098013 May 09 18:37:37.554813 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 445/880] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:37 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:37.558697 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:37.567909 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-eaee8f81-aaab-4501-b443-a112161a0ce0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.201343 May 09 18:37:37.569114 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 436/881] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:37 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:38.576563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:38.577194 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:38.586116 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:38.586931 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:38.587059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:38.587427 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:38.588861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:38.589317 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:38.593382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:38.593844 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:38.594680 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:38.595127 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:38.671957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:38.679834 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-da6ad037-b6fd-43dd-a8ab-1faeb6c0406f tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1266 microversion: 2.1 time: 0.107176 May 09 18:37:38.680596 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 446/882] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:38 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:38.744882 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:38.752027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-82275673-cf42-459f-bea4-303a246a3ff2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.170285 May 09 18:37:38.752593 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 437/883] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:38 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:39.696370 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:39.697150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:39.703777 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:39.704242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:39.705067 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:39.705521 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:39.765892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:39.768655 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:39.769275 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:39.774069 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5bfce474-ee9f-45ac-aecc-c79d78c8973a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1266 microversion: 2.1 time: 0.081567 May 09 18:37:39.774657 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 447/884] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:39 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:39.776093 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:39.776552 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:39.777323 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:39.777765 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:39.902615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:39.909847 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-20114a63-bd25-45c9-9206-17d5f2058cb9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.144995 May 09 18:37:39.910415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 438/885] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:39 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:40.790325 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:40.791005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:40.797696 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:40.798189 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:40.799030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:40.799504 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:40.927938 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:40.928632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:40.934952 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:40.935519 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:40.936298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:40.936738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:40.973346 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:40.981696 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-016286fa-c4de-41b9-b7ef-a12ac82e62a0 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1284 microversion: 2.1 time: 0.195302 May 09 18:37:40.982688 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 448/886] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:40 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:41.096919 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:41.104857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2029d368-aa79-4ec4-b031-218f2c599a98 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.181475 May 09 18:37:41.105439 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 439/887] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:40 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:42.000294 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:42.000918 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:42.007889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:42.008354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:42.009131 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:42.009830 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:42.074854 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:42.084608 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c9d5d1f8-50f2-458e-ab33-fc7e2f6a22a9 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1272 microversion: 2.1 time: 0.088428 May 09 18:37:42.085186 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 449/888] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:41 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:42.122290 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:42.122898 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:42.128964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:42.129429 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:42.130808 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:42.131291 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:42.305703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:42.312971 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4cddf395-9f86-4ec2-a161-953d2de94afb tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.194804 May 09 18:37:42.313550 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 440/889] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:42 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:42.896831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-e9ccc6b1-c699-496f-a99f-2742631f2a59 req-25e42167-c036-4167-999d-1698ff19cfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54aef81c-a005-440d-ba36-036e85d24b2d", "tag": "928a9f31-c0c6-49db-a6b3-79346a823409"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:42.905943 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e9ccc6b1-c699-496f-a99f-2742631f2a59 req-25e42167-c036-4167-999d-1698ff19cfd6 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:42.906473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e9ccc6b1-c699-496f-a99f-2742631f2a59 req-25e42167-c036-4167-999d-1698ff19cfd6 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:42.921287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-e9ccc6b1-c699-496f-a99f-2742631f2a59 req-25e42167-c036-4167-999d-1698ff19cfd6 service nova] Creating event network-changed:928a9f31-c0c6-49db-a6b3-79346a823409 for instance 54aef81c-a005-440d-ba36-036e85d24b2d on hv-cinder-84112 May 09 18:37:42.926224 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-e9ccc6b1-c699-496f-a99f-2742631f2a59 req-25e42167-c036-4167-999d-1698ff19cfd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034353 May 09 18:37:42.926853 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 450/890] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:43.102734 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:43.103524 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:43.110083 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:43.110547 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:43.111550 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:43.112004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:43.330771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:43.331596 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:43.333587 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:43.338847 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:43.340155 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:43.340300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:43.340800 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:43.342698 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bb60e366-6515-42d5-b261-f14fc4869ad8 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.244582 May 09 18:37:43.343562 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 441/891] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:43 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:43.499571 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:43.507590 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0a05f984-3fc9-428a-86d8-a8b71c8f90b3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.181010 May 09 18:37:43.508169 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 451/892] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:43 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:43.890294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:43.890835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:43.897419 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:43.897956 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:43.898819 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:43.899311 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:43.986402 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lazy-loading 'services' on Instance uuid 25b7f9f6-3920-4dc1-b126-e846eab217c5 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:37:44.067118 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0b18867e-aa91-4809-8ab9-d10089943676 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5/os-volume_attachments/667189de-7a54-44a7-b7ce-10ec37dedd74" status: 202 len: 0 microversion: 2.1 time: 0.180483 May 09 18:37:44.068101 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 442/893] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:37:43 2022] DELETE /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5/os-volume_attachments/667189de-7a54-44a7-b7ce-10ec37dedd74 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:37:44.359287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:44.359882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:44.366005 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:44.366467 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:44.367280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:44.367812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:44.525753 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:44.526448 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:44.532475 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:44.532942 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:44.533738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:44.534188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:44.661872 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:44.671570 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-36bdb66e-64b9-4618-8ef2-e9f5f7ad496a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.315974 May 09 18:37:44.672444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 452/894] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:44 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:44.725642 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:44.735254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3cbe78e8-01de-48be-a9e4-1f41ff6eb19f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.214419 May 09 18:37:44.735931 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 443/895] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:44 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:45.635812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-c92b62f5-1f98-46a8-b10b-c6bde3c7f9f0 req-dd25f07f-4ab8-41aa-bee1-eade1756cf30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac89178-8a4d-4e19-949a-c5972218cb08", "name": "network-vif-plugged", "status": "completed", "tag": "c19bbb2b-1768-4b80-966b-c5c78d575c4a"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:45.647528 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c92b62f5-1f98-46a8-b10b-c6bde3c7f9f0 req-dd25f07f-4ab8-41aa-bee1-eade1756cf30 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:45.648015 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c92b62f5-1f98-46a8-b10b-c6bde3c7f9f0 req-dd25f07f-4ab8-41aa-bee1-eade1756cf30 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:45.659170 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-c92b62f5-1f98-46a8-b10b-c6bde3c7f9f0 req-dd25f07f-4ab8-41aa-bee1-eade1756cf30 service nova] Creating event network-vif-plugged:c19bbb2b-1768-4b80-966b-c5c78d575c4a for instance 1ac89178-8a4d-4e19-949a-c5972218cb08 on hv-cinder-84112 May 09 18:37:45.664939 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-c92b62f5-1f98-46a8-b10b-c6bde3c7f9f0 req-dd25f07f-4ab8-41aa-bee1-eade1756cf30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032588 May 09 18:37:45.665983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 453/896] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:45.688419 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:45.689283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:45.696574 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:45.697044 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:45.697913 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:45.698375 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:45.753854 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:45.754718 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:45.761912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:45.762459 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:45.763508 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:45.764025 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:45.941132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:45.949247 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-56fe71e8-3577-4a71-b49a-6429856d2bcf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.265135 May 09 18:37:45.950590 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 444/897] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:45 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:45.996469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:46.004783 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a72766c2-51dd-4e28-abc3-0f6b7e0a11be tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.255820 May 09 18:37:46.005366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 454/898] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:45 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:46.232912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:46.233421 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:46.239185 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:46.239654 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:46.240425 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:46.240905 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:46.267634 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:37:46.354435 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d8726563-83d2-4a9b-86b6-f2d1b5da5ab7 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 204 len: 0 microversion: 2.1 time: 0.125222 May 09 18:37:46.355032 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 445/899] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:37:46 2022] DELETE /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:37:46.363379 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:46.364016 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:46.370317 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:46.370909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:46.371726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:46.372176 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:46.500135 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:46.508148 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e7bbda48-5066-4a54-8214-918c4ff8de06 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1513 microversion: 2.1 time: 0.148858 May 09 18:37:46.508798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 455/900] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:46 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:46.969383 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:46.970353 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:46.978727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:46.979306 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:46.980238 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:46.980758 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:47.021692 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:47.022464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:47.029942 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:47.030415 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:47.031242 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:47.031732 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:47.156941 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:47.164850 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cba111af-f9b6-4b04-8f25-0685eab0910a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.201268 May 09 18:37:47.165423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 446/901] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:46 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:47.201884 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:47.209739 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bb9a97b8-caba-4ee4-9178-b41985464657 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.191856 May 09 18:37:47.210304 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 456/902] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:47 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:47.525999 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:47.526626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:47.532439 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:47.532898 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:47.533672 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:47.534119 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:47.662991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:47.671233 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9699224f-46b7-459b-b155-90675e09c98d tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1513 microversion: 2.1 time: 0.149127 May 09 18:37:47.671821 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 447/903] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:47 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:48.183101 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:48.183962 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:48.190334 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.190918 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:48.191590 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.197913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:48.225890 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:48.226505 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:48.233465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.233926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:48.234783 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.235260 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:48.400660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:48.403836 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:48.407985 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bb1b573c-5e12-420c-ab52-cb9e753398b7 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.185917 May 09 18:37:48.408559 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 448/904] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:48 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:48.411711 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a5f92ac4-567d-4824-8e2c-a13a60256790 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.233163 May 09 18:37:48.412269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 457/905] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:48 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:48.688389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:48.689015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:48.694988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.695489 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:48.696264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:48.696712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:48.824522 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:48.832010 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ab070f5b-764c-41b8-90d8-699826268629 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1513 microversion: 2.1 time: 0.147511 May 09 18:37:48.833133 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 449/906] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:48 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:49.424958 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:49.425606 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:49.428796 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:49.429461 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:49.432964 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:49.433424 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:49.434204 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:49.434652 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:49.435713 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:49.436176 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:49.436954 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:49.437400 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:49.617416 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:49.624298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:49.624851 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-83cd03f9-36d0-477c-a11e-55e8a97e08f0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.203669 May 09 18:37:49.625433 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 458/907] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:49 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:49.631533 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6562ef5c-8622-4253-9b0b-14a1c1ff0a89 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.207255 May 09 18:37:49.632188 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 450/908] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:49 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:49.850283 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:49.851024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:49.856882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:49.857345 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:49.858120 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:49.858571 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:49.984834 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:49.992712 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8fcafa4e-e9a2-41a7-bd2b-6ecfeca7a3eb tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1513 microversion: 2.1 time: 0.147017 May 09 18:37:49.993271 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 459/909] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:49 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:50.641695 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:50.642241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:50.647253 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:50.647882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:50.649454 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:50.649779 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:50.650564 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:50.651015 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:50.653835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:50.654295 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:50.655072 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:50.655542 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:50.843495 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:50.846405 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:50.851103 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0f952e14-8a37-4ca8-95c1-26f3d2e55431 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1266 microversion: 2.1 time: 0.213403 May 09 18:37:50.851737 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 451/910] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:50 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:50.853990 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-95a43152-8ab4-4f60-bc8e-d3a0e2190282 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.210863 May 09 18:37:50.854566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 460/911] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:50 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:51.010283 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:51.011207 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:51.017389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:51.017844 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:51.018606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:51.019048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:51.145693 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:51.170163 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cb9f2ad1-b240-43d7-b1ff-2b280063ca9a tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1513 microversion: 2.1 time: 0.163572 May 09 18:37:51.170994 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 452/912] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:51 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:51.279703 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-f9555ce4-277a-4aec-81e6-c14500a6738c req-cfef0427-237e-4255-b501-0e14a24489b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54aef81c-a005-440d-ba36-036e85d24b2d", "name": "network-vif-plugged", "status": "completed", "tag": "928a9f31-c0c6-49db-a6b3-79346a823409"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:51.295127 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f9555ce4-277a-4aec-81e6-c14500a6738c req-cfef0427-237e-4255-b501-0e14a24489b4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:51.295724 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f9555ce4-277a-4aec-81e6-c14500a6738c req-cfef0427-237e-4255-b501-0e14a24489b4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:51.316354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-f9555ce4-277a-4aec-81e6-c14500a6738c req-cfef0427-237e-4255-b501-0e14a24489b4 service nova] Creating event network-vif-plugged:928a9f31-c0c6-49db-a6b3-79346a823409 for instance 54aef81c-a005-440d-ba36-036e85d24b2d on hv-cinder-84112 May 09 18:37:51.321845 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-f9555ce4-277a-4aec-81e6-c14500a6738c req-cfef0427-237e-4255-b501-0e14a24489b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046939 May 09 18:37:51.322729 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 461/913] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:37:51.867930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:51.868667 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:51.870937 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:51.872307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:51.875663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:51.876129 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:51.876911 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:51.877583 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:51.878441 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:51.878903 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:51.879722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:51.880173 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:52.377648 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:52.386746 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-762c8468-f97d-4eb3-9344-4de3dc0db159 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1454 microversion: 2.1 time: 0.523750 May 09 18:37:52.387400 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 453/914] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:51 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1454 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:52.392054 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:52.392692 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:52.397493 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:52.399239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:52.399708 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:52.401085 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:52.401743 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:52.407094 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-93803739-cf45-46a8-ae77-d2af8180809a tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.540982 May 09 18:37:52.407708 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 462/915] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:51 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:52.412591 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:52.413390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:52.419793 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:52.420265 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:52.421055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:52.421507 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:52.477971 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:52.485422 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7ad5442f-3cf2-4361-9a6b-01b7bfc2e299 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1471 microversion: 2.1 time: 0.097076 May 09 18:37:52.486194 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 454/916] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:52 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:52.609103 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-3ee1b3f7-6ba7-4f51-b262-3ee16b44c09e req-be0cfc0a-e3aa-446d-b5f7-133bde9494d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b7f9f6-3920-4dc1-b126-e846eab217c5", "name": "network-vif-deleted", "tag": "5e1ae9aa-0a11-462a-821e-04380f9105c2"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:52.617369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-3ee1b3f7-6ba7-4f51-b262-3ee16b44c09e req-be0cfc0a-e3aa-446d-b5f7-133bde9494d4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:52.617817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-3ee1b3f7-6ba7-4f51-b262-3ee16b44c09e req-be0cfc0a-e3aa-446d-b5f7-133bde9494d4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:52.629277 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-3ee1b3f7-6ba7-4f51-b262-3ee16b44c09e req-be0cfc0a-e3aa-446d-b5f7-133bde9494d4 service nova] Creating event network-vif-deleted:5e1ae9aa-0a11-462a-821e-04380f9105c2 for instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 on hv-cinder-84112 May 09 18:37:52.634201 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-3ee1b3f7-6ba7-4f51-b262-3ee16b44c09e req-be0cfc0a-e3aa-446d-b5f7-133bde9494d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028786 May 09 18:37:52.634815 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 455/917] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:37:52.634933 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:52.643090 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a88416de-f70b-4a08-aeb8-e9e18d350719 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1454 microversion: 2.1 time: 0.234031 May 09 18:37:52.643684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 463/918] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:52 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1454 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:53.424873 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:53.425499 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:53.432095 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:53.432563 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:53.433344 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:53.433792 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:53.503042 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:53.503782 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:53.510611 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:53.511077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:53.511908 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:53.512354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:53.599809 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:53.607193 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-78d11673-0c70-4071-8a52-b1323741231f tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1471 microversion: 2.1 time: 0.107964 May 09 18:37:53.607771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 464/919] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:53 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1471 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:53.678373 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:53.686186 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0b43ec92-1806-4a87-a623-5b704a1cb089 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.265612 May 09 18:37:53.686763 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 456/920] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:53 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:37:54.625503 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:54.626234 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:54.633289 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:54.633976 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:54.635563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:54.637004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:54.652382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-d31d88e1-db27-4446-b851-78fbb8cdc7e3 req-eb0b2834-902f-43bb-9fb4-2a7728a65df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac89178-8a4d-4e19-949a-c5972218cb08", "tag": "c19bbb2b-1768-4b80-966b-c5c78d575c4a"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:37:54.667964 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d31d88e1-db27-4446-b851-78fbb8cdc7e3 req-eb0b2834-902f-43bb-9fb4-2a7728a65df4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:54.668548 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d31d88e1-db27-4446-b851-78fbb8cdc7e3 req-eb0b2834-902f-43bb-9fb4-2a7728a65df4 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:54.688009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-d31d88e1-db27-4446-b851-78fbb8cdc7e3 req-eb0b2834-902f-43bb-9fb4-2a7728a65df4 service nova] Creating event network-changed:c19bbb2b-1768-4b80-966b-c5c78d575c4a for instance 1ac89178-8a4d-4e19-949a-c5972218cb08 on hv-cinder-84112 May 09 18:37:54.692330 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:54.692874 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:54.694156 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lazy-loading 'fault' on Instance uuid 25b7f9f6-3920-4dc1-b126-e846eab217c5 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:37:54.697890 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-d31d88e1-db27-4446-b851-78fbb8cdc7e3 req-eb0b2834-902f-43bb-9fb4-2a7728a65df4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047361 May 09 18:37:54.698951 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 457/921] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:37:54.706060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:54.706779 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:54.713930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:54.714395 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:54.715243 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:54.716358 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:54.751295 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e8f8cb607649c0836a9c709791fc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64dd788fefab4eeab253b0f0d341fd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:54.760475 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-82255a95-95cd-465c-9d6f-69fb5aad7b55 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 200 len: 1309 microversion: 2.1 time: 0.138790 May 09 18:37:54.761516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 465/922] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:54 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:54.881440 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:54.889021 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-671d0560-048d-4ab8-b0ae-ff8129d05408 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.188672 May 09 18:37:54.889975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 458/923] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:54 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:55.777955 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:55.778757 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] [instance: 25b7f9f6-3920-4dc1-b126-e846eab217c5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:55.784956 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:55.786130 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:55.787062 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:55.787596 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:55.802861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] HTTP exception thrown: Instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 could not be found. May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Request method failure captured: May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 HTTP/1.1 May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV8LblL2DIYYz_iC1I9oGR4X4uzt_n8zDoIm_uELbQPYLVCoklExwLcFZWOqQZUYY-QfSipRXoYfLTPxWMPEffzYBA9kS80rXETR3u2hYf7IdBIFeS0xxqGLlmU1v1q0GbT1yutE2HCLMipwHiv0CRlInuJPvxkJTPxpksW-jxR8qJM May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 64dd788fefab4eeab253b0f0d341fd2d May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-VolumesSnapshotTestJSON-209982285 May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:37:55.804649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64dd788fefab4eeab253b0f0d341fd2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64dd788fefab4eeab253b0f0d341fd2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64dd788fefab4eeab253b0f0d341fd2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64dd788fefab4eeab253b0f0d341fd2d"}]}] May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-VolumesSnapshotTestJSON-209982285 May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 64dd788fefab4eeab253b0f0d341fd2d May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-209982285 May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-VolumesSnapshotTestJSON-209982285-project May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: b2e8f8cb607649c0836a9c709791fc0e May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-VolumesSnapshotTestJSON-209982285-project May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 could not be found. May 09 18:37:55.806223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '25b7f9f6-3920-4dc1-b126-e846eab217c5'} May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 could not be found. May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:37:55.807269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 could not be found. May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 could not be found. May 09 18:37:55.808912 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:37:55.810217 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] Returning 404 to user: Instance 25b7f9f6-3920-4dc1-b126-e846eab217c5 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:37:55.810217 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2c68c3a8-4948-44f3-b073-49e8a0f2ca37 tempest-VolumesSnapshotTestJSON-209982285 tempest-VolumesSnapshotTestJSON-209982285-project] 10.222.0.25 "GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5" status: 404 len: 111 microversion: 2.1 time: 0.032023 May 09 18:37:55.810217 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 466/924] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:55 2022] GET /compute/v2.1/servers/25b7f9f6-3920-4dc1-b126-e846eab217c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:37:55.908534 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:55.909163 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:55.915462 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:55.915924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:55.916706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:55.917152 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:56.078829 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:56.087002 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cd3d3134-18b0-4dfa-939d-9669ab6a6084 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1314 microversion: 2.1 time: 0.182303 May 09 18:37:56.087611 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 459/925] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:55 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:37:57.104433 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:37:57.105060 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:37:57.111454 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:57.111924 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:57.112736 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:37:57.113228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:37:57.256181 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:37:57.264228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ee7369e2-4165-4cd1-893d-924237adab6b tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1497 microversion: 2.1 time: 0.163640 May 09 18:37:57.264795 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 467/926] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:37:57 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:02.745482 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:02.746022 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:02.752212 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:02.752673 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:02.753449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:02.754402 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:02.779819 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:38:02.852466 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-303325fc-a8f7-43d5-9dc4-96170d0ae486 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "DELETE /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 204 len: 0 microversion: 2.1 time: 0.110788 May 09 18:38:02.853044 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 460/927] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:38:02 2022] DELETE /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:38:02.861708 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:02.862367 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:02.869109 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:02.869621 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:02.870392 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:02.870841 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:02.999405 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:03.007256 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8437bdb0-b31b-447d-9ca1-6b5e7b0e0ebf tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1503 microversion: 2.1 time: 0.149484 May 09 18:38:03.007818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 468/928] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:38:02 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:38:04.025380 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:04.026025 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:04.032238 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.032700 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.033473 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:04.033922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:04.159316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:04.166553 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d12ee4e6-d322-4b11-a82f-4b38012ff285 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1503 microversion: 2.1 time: 0.145492 May 09 18:38:04.167132 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 461/929] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:38:04 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:05.183513 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:05.184136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:05.190466 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:05.190925 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:05.191717 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:05.192163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:05.322373 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:05.329720 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-15512dcb-52d3-4c7b-8527-e918a9cdeb47 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1503 microversion: 2.1 time: 0.150090 May 09 18:38:05.330267 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 469/930] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:38:05 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:06.347856 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:06.348386 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:06.354701 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:06.355160 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:06.355968 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:06.356412 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:06.481699 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:06.489544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-712416c3-eabb-4350-9e04-ac245e4eb5f4 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1503 microversion: 2.1 time: 0.146163 May 09 18:38:06.490111 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 462/931] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:38:06 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:07.506927 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:07.507782 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:07.515534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:07.517978 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:07.518794 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:07.519321 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:07.548090 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-7b3a6c12-eace-436b-93b3-65bbf3b8005e req-4c8a49e4-d364-490b-b48f-4463bd338025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54aef81c-a005-440d-ba36-036e85d24b2d", "name": "network-vif-deleted", "tag": "928a9f31-c0c6-49db-a6b3-79346a823409"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:38:07.557460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-7b3a6c12-eace-436b-93b3-65bbf3b8005e req-4c8a49e4-d364-490b-b48f-4463bd338025 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:07.557919 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-7b3a6c12-eace-436b-93b3-65bbf3b8005e req-4c8a49e4-d364-490b-b48f-4463bd338025 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:07.569706 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-7b3a6c12-eace-436b-93b3-65bbf3b8005e req-4c8a49e4-d364-490b-b48f-4463bd338025 service nova] Creating event network-vif-deleted:928a9f31-c0c6-49db-a6b3-79346a823409 for instance 54aef81c-a005-440d-ba36-036e85d24b2d on hv-cinder-84112 May 09 18:38:07.574759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-7b3a6c12-eace-436b-93b3-65bbf3b8005e req-4c8a49e4-d364-490b-b48f-4463bd338025 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030594 May 09 18:38:07.575576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 463/932] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:38:07.592408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5118d48d0412f8536c47b9dffb88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05197c0440624fce9090b97e6826d516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:38:07.600683 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0be6c7f2-5078-470e-8d74-dd74b7480636 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 200 len: 1461 microversion: 2.1 time: 0.098346 May 09 18:38:07.601252 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 470/933] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:38:07 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:38:08.618556 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:38:08.619544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] [instance: 54aef81c-a005-440d-ba36-036e85d24b2d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:38:08.625908 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:08.626365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:08.627161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:38:08.627627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:38:08.642313 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] HTTP exception thrown: Instance 54aef81c-a005-440d-ba36-036e85d24b2d could not be found. May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Request method failure captured: May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d HTTP/1.1 May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV9aQ7mL-ZmZqm7GtCXTxjTEQDD96zPebDk2A_XS10PFxnZnRw3BM_1JyEbKj1k1bj8pM3PDyThSh5RMHstC1WzcvgW_fZlxlswCjyJ6kz5kf8CsX-I0Pc9Mf3lVFR1xjn4vArz7rqMLYMb83hB6T3vnX955zhDsNkvN710AcaOGXW4 May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 05197c0440624fce9090b97e6826d516 May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-VolumesActionsTest-1174180819 May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:38:08.644077 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05197c0440624fce9090b97e6826d516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05197c0440624fce9090b97e6826d516"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05197c0440624fce9090b97e6826d516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05197c0440624fce9090b97e6826d516"}]}] May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-VolumesActionsTest-1174180819 May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 05197c0440624fce9090b97e6826d516 May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-VolumesActionsTest-1174180819 May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-VolumesActionsTest-1174180819-project May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: cdb5118d48d0412f8536c47b9dffb88c May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-VolumesActionsTest-1174180819-project May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 54aef81c-a005-440d-ba36-036e85d24b2d could not be found. May 09 18:38:08.646350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '54aef81c-a005-440d-ba36-036e85d24b2d'} May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54aef81c-a005-440d-ba36-036e85d24b2d could not be found. May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:38:08.647384 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54aef81c-a005-440d-ba36-036e85d24b2d could not be found. May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54aef81c-a005-440d-ba36-036e85d24b2d could not be found. May 09 18:38:08.648975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:38:08.650342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] Returning 404 to user: Instance 54aef81c-a005-440d-ba36-036e85d24b2d could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:38:08.650342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-96afc24f-b167-4b0f-b1a1-1550613f2be7 tempest-VolumesActionsTest-1174180819 tempest-VolumesActionsTest-1174180819-project] 10.222.0.25 "GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d" status: 404 len: 111 microversion: 2.1 time: 0.032192 May 09 18:38:08.650342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 464/934] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:38:08 2022] GET /compute/v2.1/servers/54aef81c-a005-440d-ba36-036e85d24b2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:39:09.550803 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9a9e57f6-190f-468e-b511-0c9148003e9b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Action: 'create', calling method: .version_select at 0x7f3f7e7650d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-784717331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj0aywP/hX6ItAR4MIDXChTXSieJ88vmMrB2q6Y3eVwVyw0tn5LhxCFMADM5ToMJ89tF295bHegQEUHJI6Q5uDIXbnQhMKcw2CfKT2/ZGQU3TKEu3dJJgG6wJ7ffYMHZQ=="}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:09.564451 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-9a9e57f6-190f-468e-b511-0c9148003e9b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Getting quotas for project 93b84cf540d348be994e2ddab8345520. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:39:09.568171 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-9a9e57f6-190f-468e-b511-0c9148003e9b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Getting quotas for user 0784cab1d4c142d7aeb8557ad2ab146c and project 93b84cf540d348be994e2ddab8345520. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:39:09.589396 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9a9e57f6-190f-468e-b511-0c9148003e9b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.043829 May 09 18:39:09.589983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 471/935] 10.222.0.25 () {60 vars in 1158 bytes} [Mon May 9 18:39:09 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:09.638832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1897931024", "imageRef": "80c1401e-b8d0-48d6-88ef-3069d63caea6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-784717331", "networks": [{"uuid": "8b5394fd-9ee8-4be5-9332-2fef427d3b03"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:09.688982 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] validate_networks() for [('8b5394fd-9ee8-4be5-9332-2fef427d3b03', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:39:10.049868 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:39:10.050303 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:39:10.050786 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:39:10.051227 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:39:10.051651 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:39:10.060229 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:10.060690 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:10.061508 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:10.061956 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:10.078674 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Getting quotas for project 93b84cf540d348be994e2ddab8345520. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:39:10.082580 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Getting quotas for user 0784cab1d4c142d7aeb8557ad2ab146c and project 93b84cf540d348be994e2ddab8345520. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:39:10.093271 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:39:10.095492 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80c1401e-b8d0-48d6-88ef-3069d63caea6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:39:10.140068 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-eabe741f-c737-4421-b101-19dd5f8a5e19 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506030 May 09 18:39:10.140712 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 465/936] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:39:10.150630 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b34bfe0c-71b2-4246-b0b6-ebcf176d30c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:10.151286 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b34bfe0c-71b2-4246-b0b6-ebcf176d30c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:10.204313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b34bfe0c-71b2-4246-b0b6-ebcf176d30c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:10.211120 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b34bfe0c-71b2-4246-b0b6-ebcf176d30c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1258 microversion: 2.1 time: 0.064394 May 09 18:39:10.211781 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 472/937] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:10 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:11.233788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:11.234687 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:11.244767 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:11.245237 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:11.246035 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:11.246487 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:11.317449 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:11.324615 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d13c025f-bfd0-43ea-916e-f6b0a65766b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1316 microversion: 2.1 time: 0.100607 May 09 18:39:11.325177 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 466/938] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:11 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1316 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:12.341839 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:12.342480 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:12.350113 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:12.350582 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:12.351405 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:12.351864 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:12.497061 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:12.505102 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-80df1af7-54b8-4bf3-9883-1db3bc3a8773 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.167094 May 09 18:39:12.505675 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 473/939] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:12 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:13.522361 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:13.523166 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:13.529631 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:13.530098 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:13.530884 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:13.531366 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:13.825105 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:13.832458 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-060f9272-09e7-408b-99df-d4a71fb71d83 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.314511 May 09 18:39:13.833024 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 467/940] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:13 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:14.849840 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:14.850628 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:14.857111 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:14.857638 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:14.858487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:14.859000 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:15.000014 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:15.008284 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ee73e822-c3f7-4a8d-9fa5-adb7cd779268 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.162924 May 09 18:39:15.008856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 474/941] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:14 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:16.025071 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:16.025690 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:16.031963 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:16.032425 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:16.033197 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:16.033646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:16.160972 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:16.169514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-33fd14e5-f05b-44bb-b3be-28ee29179321 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.147789 May 09 18:39:16.170115 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 468/942] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:16 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:17.189501 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:17.190354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:17.197030 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:17.197593 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:17.198598 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:17.199118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:17.341345 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:17.351162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8310af28-6c7d-4278-a96e-fc1c176e132e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.166123 May 09 18:39:17.353258 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 475/943] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:17 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:18.368839 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:18.369738 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:18.378516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:18.378516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:18.378516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:18.378516 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:18.541856 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:18.550318 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-872c5874-70a2-4824-8034-27627e22e2c6 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.184781 May 09 18:39:18.551245 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 469/944] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:18 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:19.567846 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:19.569464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:19.576254 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:19.577080 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:19.578131 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:19.578806 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:19.716722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:19.724617 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-21436534-7ee0-4f89-9e18-762ed34d1e08 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.160681 May 09 18:39:19.725196 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 476/945] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:19 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:20.741654 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:20.742261 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:20.748780 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:20.749241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:20.750009 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:20.750455 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:20.875958 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:20.883660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-473588e0-a420-4987-bafe-5ef43a9aa106 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.146312 May 09 18:39:20.884228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 470/946] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:20 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:21.769156 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-32c194c9-8444-443e-9bb6-136c1b3c7568 req-b0f01906-6ae7-4f82-9fa3-305c299aedb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e0be7b-e580-40fa-9aac-c5d59bfd9c79", "tag": "6d06943b-04f5-46e7-9825-27b3d5682858"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:21.783361 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-32c194c9-8444-443e-9bb6-136c1b3c7568 req-b0f01906-6ae7-4f82-9fa3-305c299aedb0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:21.784975 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-32c194c9-8444-443e-9bb6-136c1b3c7568 req-b0f01906-6ae7-4f82-9fa3-305c299aedb0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:21.804931 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-32c194c9-8444-443e-9bb6-136c1b3c7568 req-b0f01906-6ae7-4f82-9fa3-305c299aedb0 service nova] Creating event network-changed:6d06943b-04f5-46e7-9825-27b3d5682858 for instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 on hv-cinder-84112 May 09 18:39:21.810996 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-32c194c9-8444-443e-9bb6-136c1b3c7568 req-b0f01906-6ae7-4f82-9fa3-305c299aedb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053517 May 09 18:39:21.812041 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 477/947] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:39:21.900725 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:21.901423 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:21.908321 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:21.908882 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:21.909809 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:21.910326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:22.117827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:22.125274 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-40ac17c0-1b44-40ec-820a-a1a8812d5cbe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.228626 May 09 18:39:22.125836 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 471/948] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:21 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:23.142277 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:23.143772 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:23.150316 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:23.150772 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:23.151573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:23.152022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:23.343323 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:23.350582 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0f124a87-75ac-4029-b5b1-a482f1dcf3aa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.212493 May 09 18:39:23.351146 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 478/949] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:23 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:24.367720 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:24.368267 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:24.374832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:24.375326 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:24.376125 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:24.376564 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:24.509010 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:24.516223 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-66d64b0b-9c61-4ed3-84bb-783cf9d625dc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.152479 May 09 18:39:24.516788 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 472/950] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:24 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:25.533534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:25.534867 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:25.541206 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:25.541678 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:25.542464 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:25.542920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:25.674213 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:25.682147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e0ec98db-43a0-40d6-b8d4-3aa86a80e843 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.152524 May 09 18:39:25.682714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 479/951] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:25 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:25.917885 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-2b040aa7-279b-498b-9d18-7bbee945a16a req-60f3adae-67d1-4129-a336-9ab3409000d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e0be7b-e580-40fa-9aac-c5d59bfd9c79", "name": "network-vif-plugged", "status": "completed", "tag": "6d06943b-04f5-46e7-9825-27b3d5682858"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:25.927303 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-2b040aa7-279b-498b-9d18-7bbee945a16a req-60f3adae-67d1-4129-a336-9ab3409000d8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:25.927768 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-2b040aa7-279b-498b-9d18-7bbee945a16a req-60f3adae-67d1-4129-a336-9ab3409000d8 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:25.941297 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-2b040aa7-279b-498b-9d18-7bbee945a16a req-60f3adae-67d1-4129-a336-9ab3409000d8 service nova] Creating event network-vif-plugged:6d06943b-04f5-46e7-9825-27b3d5682858 for instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 on hv-cinder-84112 May 09 18:39:25.946189 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-2b040aa7-279b-498b-9d18-7bbee945a16a req-60f3adae-67d1-4129-a336-9ab3409000d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031963 May 09 18:39:25.946930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 473/952] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:26.698857 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:26.699483 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:26.705819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:26.706282 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:26.707056 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:26.707539 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:26.829337 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:26.836566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4d2a86d8-438d-4ae6-b48b-4bc4718b699a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1358 microversion: 2.1 time: 0.141585 May 09 18:39:26.837128 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 480/953] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:26 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:27.854217 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:27.854924 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:27.863088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:27.863574 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:27.864388 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:27.864861 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:27.992887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:28.000399 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-58ce761a-f11a-412e-8e4f-a65b6f048baa tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1548 microversion: 2.1 time: 0.150973 May 09 18:39:28.000961 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 474/954] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:27 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:28.016776 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:28.017401 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:28.023684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:28.024142 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.024910 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:28.025354 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.147032 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:28.154362 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-835494e6-f9d5-483f-8b8f-804c7313c6b5 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1548 microversion: 2.1 time: 0.141356 May 09 18:39:28.154930 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 481/955] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:28 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1548 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:28.170241 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:28.173686 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:28.175085 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Searching by: {'deleted': False, 'project_id': '93b84cf540d348be994e2ddab8345520'} {{(pid=117088) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 09 18:39:28.181475 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:28.181942 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.182753 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:28.183228 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.269695 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.multi_cell_list [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117088) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 09 18:39:28.363488 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ebbafc5a-79bb-4195-acce-98b64d7e84c3 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196883 May 09 18:39:28.364070 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 475/956] 10.222.0.25 () {58 vars in 1124 bytes} [Mon May 9 18:39:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:28.374304 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:28.374935 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:28.380742 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:28.381231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.382024 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:28.382467 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:28.505231 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:28.512404 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0e262e75-6c79-40fa-9074-93ce26480333 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1548 microversion: 2.1 time: 0.141887 May 09 18:39:28.512965 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 482/957] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:28 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1548 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:30.016240 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-90e396dd-a380-48b3-9ed4-a33109755d1a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c86edf91-0124-4557-ba12-5ef5396e947d"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:30.017335 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-90e396dd-a380-48b3-9ed4-a33109755d1a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:30.023691 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90e396dd-a380-48b3-9ed4-a33109755d1a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:30.024171 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90e396dd-a380-48b3-9ed4-a33109755d1a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:30.024943 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90e396dd-a380-48b3-9ed4-a33109755d1a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:30.025397 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90e396dd-a380-48b3-9ed4-a33109755d1a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:30.265190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-90e396dd-a380-48b3-9ed4-a33109755d1a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252696 May 09 18:39:30.265806 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 476/958] 10.222.0.25 () {60 vars in 1322 bytes} [Mon May 9 18:39:30 2022] POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:37.787278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:37.787909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:37.794074 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:37.794553 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:37.795360 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:37.795801 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:38.072590 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:38.080387 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-861c11d4-2b0a-4d63-bd5d-d25784c9f5ab tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1594 microversion: 2.1 time: 0.297408 May 09 18:39:38.080954 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 483/959] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:37 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1594 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:39.954812 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-6472b4b3-b98c-4dd8-90e5-b6467bd5415b req-898d1838-39fd-4929-bf18-dce9958e028d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e0be7b-e580-40fa-9aac-c5d59bfd9c79", "tag": "6d06943b-04f5-46e7-9825-27b3d5682858"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:39.963755 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6472b4b3-b98c-4dd8-90e5-b6467bd5415b req-898d1838-39fd-4929-bf18-dce9958e028d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:39.964263 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6472b4b3-b98c-4dd8-90e5-b6467bd5415b req-898d1838-39fd-4929-bf18-dce9958e028d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:39.976932 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-6472b4b3-b98c-4dd8-90e5-b6467bd5415b req-898d1838-39fd-4929-bf18-dce9958e028d service nova] Creating event network-changed:6d06943b-04f5-46e7-9825-27b3d5682858 for instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 on hv-cinder-84112 May 09 18:39:39.982568 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-6472b4b3-b98c-4dd8-90e5-b6467bd5415b req-898d1838-39fd-4929-bf18-dce9958e028d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032379 May 09 18:39:39.983382 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 477/960] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:40.992909 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-26782090"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:40.993465 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:41.000166 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:41.000628 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:41.001412 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:41.001865 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:41.130183 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.network.security_group_api [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Adding security group 51a60c73-8f2d-4e57-a040-ab272135b270 to port 6d06943b-04f5-46e7-9825-27b3d5682858 May 09 18:39:41.480766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5b24acd8-9b5d-4da2-bf8b-ba04db2ab80d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/action" status: 202 len: 0 microversion: 2.1 time: 0.491237 May 09 18:39:41.481198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 484/961] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:39:40 2022] POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:39:41.490481 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:39:41.492678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:39:41.505502 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:41.505969 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:41.506781 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:41.507274 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:41.730795 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:39:41.739529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7920b735-c459-4de7-bbaa-13d97728eedc tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1758 microversion: 2.1 time: 0.253721 May 09 18:39:41.740126 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 478/962] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:39:41 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1758 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:39:42.000766 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-550f43f9-3372-4ca1-be75-0a81deb829ac req-817a1d62-1fd5-45c6-8263-865f43fd43d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e0be7b-e580-40fa-9aac-c5d59bfd9c79", "tag": "6d06943b-04f5-46e7-9825-27b3d5682858"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:39:42.010645 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-550f43f9-3372-4ca1-be75-0a81deb829ac req-817a1d62-1fd5-45c6-8263-865f43fd43d5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:39:42.011118 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-550f43f9-3372-4ca1-be75-0a81deb829ac req-817a1d62-1fd5-45c6-8263-865f43fd43d5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:39:42.022527 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-550f43f9-3372-4ca1-be75-0a81deb829ac req-817a1d62-1fd5-45c6-8263-865f43fd43d5 service nova] Creating event network-changed:6d06943b-04f5-46e7-9825-27b3d5682858 for instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 on hv-cinder-84112 May 09 18:39:42.027942 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-550f43f9-3372-4ca1-be75-0a81deb829ac req-817a1d62-1fd5-45c6-8263-865f43fd43d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031284 May 09 18:39:42.028720 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 485/963] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:39:46.469282 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:39:46.469825 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Mon May 9 18:39:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:40:00.944236 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:40:00.944881 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Mon May 9 18:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:40:02.309948 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:02.310532 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:02.316887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:02.317381 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:02.318239 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:02.318734 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:02.343130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:40:02.417854 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-587d4089-4f3f-4391-ab3b-d881bcf6bd56 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 204 len: 0 microversion: 2.1 time: 0.111351 May 09 18:40:02.418510 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 479/964] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:40:02 2022] DELETE /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:40:02.427261 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:02.427965 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:02.434066 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:02.434523 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:02.435356 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:02.435802 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:02.562468 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:02.570381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bc488403-a47c-420c-a8fa-a403a75a41f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1579 microversion: 2.1 time: 0.147483 May 09 18:40:02.570950 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 486/965] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:02 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1579 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:03.588376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:03.589088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:03.595411 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:03.595873 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:03.596657 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:03.597104 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:03.733000 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:03.740398 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5e60cd48-4543-4c78-a562-183d481b90a9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1579 microversion: 2.1 time: 0.156297 May 09 18:40:03.740971 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 480/966] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:03 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:04.106305 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b18b5df4-fe53-4146-b222-b8a6935f0626 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:04.107499 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b18b5df4-fe53-4146-b222-b8a6935f0626 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:04.113892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b18b5df4-fe53-4146-b222-b8a6935f0626 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.114355 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b18b5df4-fe53-4146-b222-b8a6935f0626 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.115146 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b18b5df4-fe53-4146-b222-b8a6935f0626 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.115624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b18b5df4-fe53-4146-b222-b8a6935f0626 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.187355 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b18b5df4-fe53-4146-b222-b8a6935f0626 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/action" status: 202 len: 0 microversion: 2.1 time: 0.084785 May 09 18:40:04.188418 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 487/967] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:40:04 2022] POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:40:04.197387 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:04.198040 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:04.204911 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.205379 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.206254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.206703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.528670 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:04.536526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aecd8de1-f52f-442e-90bf-c667170b827f tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1750 microversion: 2.1 time: 0.343944 May 09 18:40:04.537113 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 481/968] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:04 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1750 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:04.759046 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:04.759819 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:04.765876 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.766359 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:04.767200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:04.767602 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:05.269495 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:05.276816 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9876abc6-54bf-4092-95a3-ae5a7c53648f tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1579 microversion: 2.1 time: 0.522738 May 09 18:40:05.277393 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 488/969] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:04 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1579 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:05.554997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:05.555760 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:05.562319 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:05.562793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:05.563621 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:05.564075 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:05.835038 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:05.843034 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-adf80f4f-ec75-46b0-a13f-7578077d946c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1750 microversion: 2.1 time: 0.293061 May 09 18:40:05.844415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 482/970] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:05 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1750 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:05.876416 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-a13d18f3-3aba-454a-95bc-736b1df399cf req-d1929ff8-5b16-46d4-8084-98bf728b41f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac89178-8a4d-4e19-949a-c5972218cb08", "name": "network-vif-deleted", "tag": "c19bbb2b-1768-4b80-966b-c5c78d575c4a"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:05.890898 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-a13d18f3-3aba-454a-95bc-736b1df399cf req-d1929ff8-5b16-46d4-8084-98bf728b41f5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:05.891754 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-a13d18f3-3aba-454a-95bc-736b1df399cf req-d1929ff8-5b16-46d4-8084-98bf728b41f5 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:05.907123 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-a13d18f3-3aba-454a-95bc-736b1df399cf req-d1929ff8-5b16-46d4-8084-98bf728b41f5 service nova] Creating event network-vif-deleted:c19bbb2b-1768-4b80-966b-c5c78d575c4a for instance 1ac89178-8a4d-4e19-949a-c5972218cb08 on hv-cinder-84112 May 09 18:40:05.913826 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-a13d18f3-3aba-454a-95bc-736b1df399cf req-d1929ff8-5b16-46d4-8084-98bf728b41f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042428 May 09 18:40:05.914522 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 489/971] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:06.293582 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:06.294415 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:06.301573 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:06.302128 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:06.303066 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:06.303687 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:06.340291 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:06.340784 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:06.341248 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lazy-loading 'fault' on Instance uuid 1ac89178-8a4d-4e19-949a-c5972218cb08 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:40:06.382264 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:06.389599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-087fba05-0f95-4e92-9388-f57b7191131d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 200 len: 1231 microversion: 2.1 time: 0.099955 May 09 18:40:06.390171 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 483/972] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:06 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:06.862911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:06.863662 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:06.870603 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:06.871348 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:06.872129 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:06.872612 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:07.024430 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:07.032233 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-73911d6d-e2a8-47dd-bf55-3f95520a4f4b tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.174121 May 09 18:40:07.032798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 490/973] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:06 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:07.407324 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:07.407953 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:07.414587 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:07.415053 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:07.415855 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:07.416304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:07.429396 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] HTTP exception thrown: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Request method failure captured: May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 HTTP/1.1 May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV9GIpBHu9s_yeeZut2aMesYEHZrvuaGkHVfJX6Re2HIOC2JXx36TRty_H6NWzBT_gCya_N7s_jvBK01BNYmIWpG3A-ATaQ1WR6N2usEuSQ13uySK3CPi3B8F4U1uX13Z8NDrPFl13VNWpInMPN8ApFwu2hGYOFHtLqJjaKdXAmhtpE May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:40:07.431057 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_84f9c806f7d54963bd886eae2ab22c38"}]}] May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-TestVolumeBootPattern-1956176469 May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-TestVolumeBootPattern-1956176469-project May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: d1934a2e2edb4b8a93baac501c9c5c3b May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-TestVolumeBootPattern-1956176469-project May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:40:07.432813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '1ac89178-8a4d-4e19-949a-c5972218cb08'} May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:40:07.433980 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:40:07.435646 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:07.437061 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Returning 404 to user: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:40:07.437061 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a9dcbb63-0032-4266-bdce-8d0e26dfc0d6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 404 len: 111 microversion: 2.1 time: 0.029054 May 09 18:40:07.437061 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 484/974] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:07 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:40:07.523993 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1605613444", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2017172084", "security_groups": [{"name": "tempest-secgroup-smoke-531814017"}], "block_device_mapping_v2": [{"uuid": "f90c3b50-2609-469d-b8b3-4f570d49dccb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d96723e-3ac9-459f-80bb-639b9429b963"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:07.631163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] validate_networks() for [('8d96723e-3ac9-459f-80bb-639b9429b963', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:40:08.008664 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:40:08.009408 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:40:08.009715 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:40:08.010145 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:40:08.010572 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:40:08.020036 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:08.020503 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:08.021327 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:08.021815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:08.037796 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:40:08.041690 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for user d1934a2e2edb4b8a93baac501c9c5c3b and project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'instances', 'ram', 'cores'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:40:08.049867 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:08.050497 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:08.056754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:08.057215 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:08.058385 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:08.058842 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:08.098022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:40:08.100244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f90c3b50-2609-469d-b8b3-4f570d49dccb',volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:40:08.202161 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:08.211361 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-71318346-aa71-49d8-9cd0-62f163c611d7 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.165324 May 09 18:40:08.211912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 485/975] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:08 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:08.228061 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-673c31bc-fd6f-4650-bb61-1090795b15b9 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708512 May 09 18:40:08.228704 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 491/976] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:40:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 18:40:08.238593 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-620fdb0a-5a93-4047-b728-eaeeb155abce tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:08.239254 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-620fdb0a-5a93-4047-b728-eaeeb155abce tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:08.292474 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-620fdb0a-5a93-4047-b728-eaeeb155abce tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:08.298830 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-620fdb0a-5a93-4047-b728-eaeeb155abce tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1095 microversion: 2.1 time: 0.064138 May 09 18:40:08.299452 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 486/977] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:08 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:09.227843 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:09.228727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:09.236783 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:09.237346 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:09.238134 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:09.238599 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:09.315544 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:09.316446 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:09.324732 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:09.325538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:09.331676 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:09.332277 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:09.434926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:09.442431 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2bacd452-7f78-499e-9c0c-d9c53fcc53e0 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1211 microversion: 2.1 time: 0.131260 May 09 18:40:09.443042 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 487/978] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:09 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:09.501125 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:09.509308 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f0f59be2-7a15-4d39-8f87-3bf1091ed883 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.285505 May 09 18:40:09.509972 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 492/979] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:09 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:10.459359 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:10.459981 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:10.466217 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:10.466680 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:10.467485 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:10.467963 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:10.530046 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:10.531919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:10.540080 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:10.540839 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:10.541944 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:10.542608 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:10.746526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:10.753791 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7317f582-ae71-4e8d-8dea-d5db5bd8f2c6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.298341 May 09 18:40:10.754360 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 488/980] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:10 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:10.820856 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:10.828866 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3e79636a-a307-4160-837e-73b3116f956a tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.306050 May 09 18:40:10.829432 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 493/981] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:10 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:10.981977 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-386c50d7-2407-4698-855f-6f16385a66c7 req-c0c31b1b-73f8-4715-9eb4-648ce561b234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a75af1-168a-42af-bf8e-d6686993ec57", "tag": "e62aae24-a129-4bd3-8fc6-1ca8a30531c5"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:10.992930 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-386c50d7-2407-4698-855f-6f16385a66c7 req-c0c31b1b-73f8-4715-9eb4-648ce561b234 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:10.993463 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-386c50d7-2407-4698-855f-6f16385a66c7 req-c0c31b1b-73f8-4715-9eb4-648ce561b234 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:11.005301 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-386c50d7-2407-4698-855f-6f16385a66c7 req-c0c31b1b-73f8-4715-9eb4-648ce561b234 service nova] Creating event network-changed:e62aae24-a129-4bd3-8fc6-1ca8a30531c5 for instance b6a75af1-168a-42af-bf8e-d6686993ec57 on hv-cinder-84112 May 09 18:40:11.010950 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-386c50d7-2407-4698-855f-6f16385a66c7 req-c0c31b1b-73f8-4715-9eb4-648ce561b234 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108466 May 09 18:40:11.011719 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 489/982] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:11.771668 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:11.772321 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:11.778470 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:11.778927 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:11.779727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:11.780225 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:11.846875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:11.847771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:11.854453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:11.854991 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:11.855862 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:11.856316 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:12.054896 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:12.062205 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9207a3ee-dc8f-4eec-b11a-63f741d0dc0a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.295296 May 09 18:40:12.062782 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 494/983] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:11 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:12.101428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:12.109475 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e7ba0298-fb01-498c-bd8d-c209da1a3c51 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.267292 May 09 18:40:12.115548 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 490/984] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:11 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:13.079588 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:13.080214 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:13.087376 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:13.087835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:13.088636 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:13.089084 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:13.126005 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:13.126652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:13.133135 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:13.133684 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:13.134482 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:13.134936 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:13.267821 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:13.275560 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-eabe6513-6481-4eb1-8709-674c687b4a65 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.199731 May 09 18:40:13.276133 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 495/985] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:13 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:13.305775 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:13.313604 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-26664e9a-c3ef-4de4-bfa7-056f7086f64c tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.191426 May 09 18:40:13.314173 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 491/986] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:13 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:14.292039 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:14.292697 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:14.298957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:14.299449 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:14.300248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:14.300689 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:14.329807 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:14.330465 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:14.336764 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:14.337227 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:14.338007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:14.338453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:14.472055 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:14.479815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-088599bf-71d4-44eb-9a0b-8a180bd8d1d2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.192258 May 09 18:40:14.480381 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 496/987] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:14 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:14.510639 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:14.518393 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e1b22371-d09a-45d8-a3a0-90a481b11ffe tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.192454 May 09 18:40:14.518965 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 492/988] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:14 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:15.497300 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:15.497930 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:15.504566 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:15.505036 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:15.506435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:15.506889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:15.535296 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:15.535925 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:15.542176 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:15.542634 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:15.543517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:15.543960 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:15.687771 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:15.695074 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8c80fb4b-3b26-48dd-bced-4f97dd138f14 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.201913 May 09 18:40:15.704455 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 497/989] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:15 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:15.725904 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:15.742370 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c3a6205a-8a66-4511-9c8c-842cd022f952 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.204396 May 09 18:40:15.742370 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 493/990] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:15 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:16.712901 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:16.713533 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:16.719916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:16.720377 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:16.721155 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:16.721602 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:16.754130 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:16.754880 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:16.762018 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:16.762552 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:16.763369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:16.763820 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:16.896815 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:16.904237 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-28dfa93d-a68b-4804-87c3-042cb7c7232a tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.195891 May 09 18:40:16.904847 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 498/991] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:16 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:16.936841 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:16.950674 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-07724f0b-df66-4109-8b0e-346f69dd8a00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.200231 May 09 18:40:16.951300 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 494/992] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:16 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:17.920983 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:17.921535 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:17.927812 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:17.928269 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:17.929037 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:17.929481 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:17.968369 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:17.968998 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:17.975709 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:17.976176 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:17.976967 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:17.977418 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:18.112158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:18.121017 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0eae8ca0-3e65-440d-a522-1823f0f8d70b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.203898 May 09 18:40:18.131249 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 499/993] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:17 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:18.155339 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:18.163522 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7ebf88e7-4680-47df-838d-edfe79997070 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.199403 May 09 18:40:18.164126 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 495/994] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:17 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:19.137834 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:19.138512 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:19.144734 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:19.145193 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:19.145969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:19.147048 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:19.179767 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:19.180513 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:19.187102 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:19.187598 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:19.188396 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:19.188849 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:19.584513 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:19.591767 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-aebd4c86-3b69-4110-9b5e-cbe1fef11820 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.457767 May 09 18:40:19.592532 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 500/995] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:19 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:19.621962 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:19.629632 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b98128b7-cb12-4580-9c7d-b501c5c9f6b8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.453679 May 09 18:40:19.630197 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 496/996] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:19 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:20.151884 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-739a4d6f-8c9d-413b-b11d-fe4a82aeb266 req-1ce947fb-4693-4370-877d-6f1785ae1810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a75af1-168a-42af-bf8e-d6686993ec57", "name": "network-vif-plugged", "status": "completed", "tag": "e62aae24-a129-4bd3-8fc6-1ca8a30531c5"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:20.160476 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-739a4d6f-8c9d-413b-b11d-fe4a82aeb266 req-1ce947fb-4693-4370-877d-6f1785ae1810 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.160941 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-739a4d6f-8c9d-413b-b11d-fe4a82aeb266 req-1ce947fb-4693-4370-877d-6f1785ae1810 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.172390 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-739a4d6f-8c9d-413b-b11d-fe4a82aeb266 req-1ce947fb-4693-4370-877d-6f1785ae1810 service nova] Creating event network-vif-plugged:e62aae24-a129-4bd3-8fc6-1ca8a30531c5 for instance b6a75af1-168a-42af-bf8e-d6686993ec57 on hv-cinder-84112 May 09 18:40:20.177303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-739a4d6f-8c9d-413b-b11d-fe4a82aeb266 req-1ce947fb-4693-4370-877d-6f1785ae1810 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029179 May 09 18:40:20.178569 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 501/997] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:20.608236 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:20.608862 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:20.615062 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.615556 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.616350 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.616839 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.648078 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:20.648798 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:20.654860 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.655367 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.656161 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:20.656615 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:20.791771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:20.799101 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e9edb082-74cb-47b1-9f9d-7887e4e6e48e tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1266 microversion: 2.1 time: 0.194702 May 09 18:40:20.799723 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 497/998] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:20 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:20.830861 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:20.839166 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-daee0553-ede9-4660-8fbb-371f134e82d0 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.195899 May 09 18:40:20.839758 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 502/999] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:20 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:21.816291 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:21.816922 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:21.823298 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:21.823759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:21.824533 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:21.824982 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:21.856691 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:21.857319 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:21.863721 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:21.864343 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:21.865774 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:21.866210 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:22.002901 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:22.010253 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3e12ba10-49b0-4c5e-8e25-86fc082f7cf8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1453 microversion: 2.1 time: 0.197797 May 09 18:40:22.010827 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 498/1000] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:21 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:22.026473 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:22.027100 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:22.032822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:22.033287 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:22.034058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:22.034517 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:22.044006 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:22.052071 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2a2f2bd7-43b0-4a00-b683-37207f539a0e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1755 microversion: 2.1 time: 0.199335 May 09 18:40:22.052701 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 503/1001] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:21 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:22.165678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:22.173006 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1ec3a97a-3df3-4d49-a069-77074140b656 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1453 microversion: 2.1 time: 0.150267 May 09 18:40:22.173576 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 499/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:22 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:40:23.069888 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:23.070549 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:23.076905 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:23.077372 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:23.078163 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:23.078614 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:23.291639 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:40:23.300835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-18b865d0-21d7-404e-bb7f-9966ef3a32b1 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1758 microversion: 2.1 time: 0.235535 May 09 18:40:23.301407 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 504/1003] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:40:23 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:40:23.844012 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-81a04226-73f2-4251-9e9f-0e6404263377 req-9b5cd3e0-c254-403d-907f-d54815957615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a75af1-168a-42af-bf8e-d6686993ec57", "tag": "e62aae24-a129-4bd3-8fc6-1ca8a30531c5"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:23.852691 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-81a04226-73f2-4251-9e9f-0e6404263377 req-9b5cd3e0-c254-403d-907f-d54815957615 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:23.853143 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-81a04226-73f2-4251-9e9f-0e6404263377 req-9b5cd3e0-c254-403d-907f-d54815957615 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:23.864093 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-81a04226-73f2-4251-9e9f-0e6404263377 req-9b5cd3e0-c254-403d-907f-d54815957615 service nova] Creating event network-changed:e62aae24-a129-4bd3-8fc6-1ca8a30531c5 for instance b6a75af1-168a-42af-bf8e-d6686993ec57 on hv-cinder-84112 May 09 18:40:23.870391 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-81a04226-73f2-4251-9e9f-0e6404263377 req-9b5cd3e0-c254-403d-907f-d54815957615 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029835 May 09 18:40:23.871229 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 500/1004] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:56.626762 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-26782090"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:56.627406 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:56.633980 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:56.634442 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:56.635258 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:56.635714 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:56.763145 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.network.security_group_api [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Removing security group 51a60c73-8f2d-4e57-a040-ab272135b270 from port 6d06943b-04f5-46e7-9825-27b3d5682858 May 09 18:40:57.091668 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bbfc674c-03fa-4162-bd91-9d62af58ce00 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/action" status: 202 len: 0 microversion: 2.1 time: 0.469182 May 09 18:40:57.102768 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-00426223-4bdb-4987-8f50-bb7c66d86c62 req-02d20a43-6bca-474d-9eca-3daddac4af48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e0be7b-e580-40fa-9aac-c5d59bfd9c79", "tag": "6d06943b-04f5-46e7-9825-27b3d5682858"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:57.103563 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 505/1005] 10.222.0.25 () {60 vars in 1277 bytes} [Mon May 9 18:40:56 2022] POST /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:40:57.113368 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-00426223-4bdb-4987-8f50-bb7c66d86c62 req-02d20a43-6bca-474d-9eca-3daddac4af48 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:57.113833 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-00426223-4bdb-4987-8f50-bb7c66d86c62 req-02d20a43-6bca-474d-9eca-3daddac4af48 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:57.126614 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-00426223-4bdb-4987-8f50-bb7c66d86c62 req-02d20a43-6bca-474d-9eca-3daddac4af48 service nova] Creating event network-changed:6d06943b-04f5-46e7-9825-27b3d5682858 for instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 on hv-cinder-84112 May 09 18:40:57.132497 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-00426223-4bdb-4987-8f50-bb7c66d86c62 req-02d20a43-6bca-474d-9eca-3daddac4af48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035110 May 09 18:40:57.134169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 501/1006] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:58.434752 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:58.435447 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:58.437817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-232ce79d-cafb-4ed8-822a-5f2557c08743 req-c0eeb4cd-8ddb-4057-9273-886762608e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e0be7b-e580-40fa-9aac-c5d59bfd9c79", "tag": "6d06943b-04f5-46e7-9825-27b3d5682858"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:40:58.442395 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:58.443088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:58.444643 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:58.445159 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:58.446663 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-232ce79d-cafb-4ed8-822a-5f2557c08743 req-c0eeb4cd-8ddb-4057-9273-886762608e71 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:58.447123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-232ce79d-cafb-4ed8-822a-5f2557c08743 req-c0eeb4cd-8ddb-4057-9273-886762608e71 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:58.457898 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-232ce79d-cafb-4ed8-822a-5f2557c08743 req-c0eeb4cd-8ddb-4057-9273-886762608e71 service nova] Creating event network-changed:6d06943b-04f5-46e7-9825-27b3d5682858 for instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 on hv-cinder-84112 May 09 18:40:58.463735 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-232ce79d-cafb-4ed8-822a-5f2557c08743 req-c0eeb4cd-8ddb-4057-9273-886762608e71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030404 May 09 18:40:58.464686 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 502/1007] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:58.528713 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lazy-loading 'services' on Instance uuid 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 18:40:58.602835 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d1dd6275-3c41-4cc8-90ab-807e0b283a2d tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments/c86edf91-0124-4557-ba12-5ef5396e947d" status: 202 len: 0 microversion: 2.1 time: 0.171926 May 09 18:40:58.612546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-db7063a8-4ccb-4669-9bc3-b37e42be1b03 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:58.613830 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-db7063a8-4ccb-4669-9bc3-b37e42be1b03 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:58.617145 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 506/1008] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:40:58 2022] DELETE /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments/c86edf91-0124-4557-ba12-5ef5396e947d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:40:58.620901 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db7063a8-4ccb-4669-9bc3-b37e42be1b03 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:58.621427 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db7063a8-4ccb-4669-9bc3-b37e42be1b03 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:58.622258 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db7063a8-4ccb-4669-9bc3-b37e42be1b03 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:58.622702 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db7063a8-4ccb-4669-9bc3-b37e42be1b03 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:58.655211 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-db7063a8-4ccb-4669-9bc3-b37e42be1b03 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 May 09 18:40:58.659347 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 503/1009] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:40:58 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:40:59.667825 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b5f6be22-2201-4b73-9a27-dd7858cfd915 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:59.668892 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b5f6be22-2201-4b73-9a27-dd7858cfd915 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:59.675004 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b5f6be22-2201-4b73-9a27-dd7858cfd915 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.675506 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b5f6be22-2201-4b73-9a27-dd7858cfd915 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.676287 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b5f6be22-2201-4b73-9a27-dd7858cfd915 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.676727 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b5f6be22-2201-4b73-9a27-dd7858cfd915 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.704171 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b5f6be22-2201-4b73-9a27-dd7858cfd915 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041930 May 09 18:40:59.704716 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 507/1010] 10.222.0.25 () {58 vars in 1301 bytes} [Mon May 9 18:40:59 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 18:40:59.714779 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:40:59.715300 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:40:59.721416 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.721876 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.722647 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:40:59.723089 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:40:59.795514 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] HTTP exception thrown: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 is not attached to volume c86edf91-0124-4557-ba12-5ef5396e947d May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Request method failure captured: May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: DELETE /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments/c86edf91-0124-4557-ba12-5ef5396e947d HTTP/1.1 May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV-_6ojzAAaf_D5sEDX_tOA6F1S7uw6jmJkVEXTpDvU95PfX8FJHMSn0sRJoWeB_lh3JPI-GwjJ6XEL26zomqmZoaQG6s2Fyqvr4XJ44v5cxw4C-LKZ6PsjnbK2iPvLwvRcYyhAUV0_ZafT1a-Uz2JhEBQUwcm0vM6bXW8FOFN-L4RA May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 93b84cf540d348be994e2ddab8345520 May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-TestMinimumBasicScenario-668433645 May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:40:59.797857 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93b84cf540d348be994e2ddab8345520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93b84cf540d348be994e2ddab8345520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93b84cf540d348be994e2ddab8345520"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93b84cf540d348be994e2ddab8345520"}]}] May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-TestMinimumBasicScenario-668433645 May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 93b84cf540d348be994e2ddab8345520 May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-TestMinimumBasicScenario-668433645 May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-TestMinimumBasicScenario-668433645-project May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 0784cab1d4c142d7aeb8557ad2ab146c May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-TestMinimumBasicScenario-668433645-project May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:40:59.799476 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 is not attached to volume c86edf91-0124-4557-ba12-5ef5396e947d May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'server_id': '62e0be7b-e580-40fa-9aac-c5d59bfd9c79', 'id': 'c86edf91-0124-4557-ba12-5ef5396e947d'} May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c86edf91-0124-4557-ba12-5ef5396e947d. May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:40:59.800557 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 is not attached to volume c86edf91-0124-4557-ba12-5ef5396e947d May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 is not attached to volume c86edf91-0124-4557-ba12-5ef5396e947d May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:40:59.802268 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Returning 404 to user: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 is not attached to volume c86edf91-0124-4557-ba12-5ef5396e947d {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:40:59.803987 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-76edde40-0091-4cdc-8036-5688bac66975 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments/c86edf91-0124-4557-ba12-5ef5396e947d" status: 404 len: 154 microversion: 2.1 time: 0.088423 May 09 18:40:59.803987 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 504/1011] 10.222.0.25 () {58 vars in 1415 bytes} [Mon May 9 18:40:59 2022] DELETE /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79/os-volume_attachments/c86edf91-0124-4557-ba12-5ef5396e947d => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:41:00.934584 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:00.935088 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:00.941252 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:00.941708 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:00.942479 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:00.942919 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:00.966669 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:41:01.038457 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9de7ef25-bb2d-46ce-a653-31900b91c519 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 204 len: 0 microversion: 2.1 time: 0.106718 May 09 18:41:01.039158 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 508/1012] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:41:00 2022] DELETE /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:41:01.047501 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:01.048187 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:01.054501 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:01.054968 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:01.055770 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:01.056234 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:01.182526 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:01.189777 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4c182c70-fe68-4cc7-951c-985a64f0ed01 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1554 microversion: 2.1 time: 0.146285 May 09 18:41:01.190343 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 505/1013] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:41:01 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:41:02.206439 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:02.207149 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:02.213494 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:02.213906 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:02.214684 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:02.215136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:02.340941 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:02.348162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-998c6ccd-bdfc-4bf9-a508-229320e29569 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1554 microversion: 2.1 time: 0.146006 May 09 18:41:02.348726 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 509/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:41:02 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:03.282754 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-4ff97727-ec5d-48f0-8b48-72eb1792e304 req-70dd2dcd-08c0-48e0-81d1-11404abea50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e0be7b-e580-40fa-9aac-c5d59bfd9c79", "name": "network-vif-deleted", "tag": "6d06943b-04f5-46e7-9825-27b3d5682858"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:41:03.292377 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-4ff97727-ec5d-48f0-8b48-72eb1792e304 req-70dd2dcd-08c0-48e0-81d1-11404abea50d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:03.292832 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-4ff97727-ec5d-48f0-8b48-72eb1792e304 req-70dd2dcd-08c0-48e0-81d1-11404abea50d service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:03.304107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-4ff97727-ec5d-48f0-8b48-72eb1792e304 req-70dd2dcd-08c0-48e0-81d1-11404abea50d service nova] Creating event network-vif-deleted:6d06943b-04f5-46e7-9825-27b3d5682858 for instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 on hv-cinder-84112 May 09 18:41:03.308759 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-4ff97727-ec5d-48f0-8b48-72eb1792e304 req-70dd2dcd-08c0-48e0-81d1-11404abea50d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029700 May 09 18:41:03.309427 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 506/1015] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:41:03.364649 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:03.365461 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:03.372307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:03.372764 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:03.373801 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:03.374244 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:03.438147 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784cab1d4c142d7aeb8557ad2ab146c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b84cf540d348be994e2ddab8345520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:41:03.446313 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-32b5e0f5-629d-4677-b81a-8320556adce8 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 200 len: 1343 microversion: 2.1 time: 0.085428 May 09 18:41:03.446818 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 510/1016] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:41:03 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 1343 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:41:04.465028 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:04.465796 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] [instance: 62e0be7b-e580-40fa-9aac-c5d59bfd9c79] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:41:04.472123 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:04.472593 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:04.473387 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:41:04.473843 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:41:04.486881 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] HTTP exception thrown: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 could not be found. May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Request method failure captured: May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 HTTP/1.1 May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV-_6ojzAAaf_D5sEDX_tOA6F1S7uw6jmJkVEXTpDvU95PfX8FJHMSn0sRJoWeB_lh3JPI-GwjJ6XEL26zomqmZoaQG6s2Fyqvr4XJ44v5cxw4C-LKZ6PsjnbK2iPvLwvRcYyhAUV0_ZafT1a-Uz2JhEBQUwcm0vM6bXW8FOFN-L4RA May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 93b84cf540d348be994e2ddab8345520 May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-TestMinimumBasicScenario-668433645 May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:41:04.488523 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93b84cf540d348be994e2ddab8345520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93b84cf540d348be994e2ddab8345520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93b84cf540d348be994e2ddab8345520"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93b84cf540d348be994e2ddab8345520"}]}] May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-TestMinimumBasicScenario-668433645 May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 93b84cf540d348be994e2ddab8345520 May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-TestMinimumBasicScenario-668433645 May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-TestMinimumBasicScenario-668433645-project May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: 0784cab1d4c142d7aeb8557ad2ab146c May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-TestMinimumBasicScenario-668433645-project May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 could not be found. May 09 18:41:04.490190 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '62e0be7b-e580-40fa-9aac-c5d59bfd9c79'} May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 could not be found. May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:41:04.491107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 could not be found. May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 could not be found. May 09 18:41:04.492660 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:41:04.494529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Returning 404 to user: Instance 62e0be7b-e580-40fa-9aac-c5d59bfd9c79 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:41:04.494529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8f9cccc6-ec97-477f-b2e4-8059b581ac54 tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79" status: 404 len: 111 microversion: 2.1 time: 0.030127 May 09 18:41:04.494529 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 507/1017] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:41:04 2022] GET /compute/v2.1/servers/62e0be7b-e580-40fa-9aac-c5d59bfd9c79 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:41:04.498823 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a5aa5586-c89a-4cce-8468-11aed823171e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] Calling method '.version_select at 0x7f3f7e865310>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:41:04.516473 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a5aa5586-c89a-4cce-8468-11aed823171e tempest-TestMinimumBasicScenario-668433645 tempest-TestMinimumBasicScenario-668433645-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-784717331" status: 202 len: 0 microversion: 2.1 time: 0.021673 May 09 18:41:04.517035 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 511/1018] 10.222.0.25 () {58 vars in 1268 bytes} [Mon May 9 18:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-784717331 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:42:10.720365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1334635650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2017172084", "security_groups": [{"name": "tempest-secgroup-smoke-531814017"}], "block_device_mapping_v2": [{"uuid": "dcf7dece-766c-4e40-8acd-fd2f4499e2dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d96723e-3ac9-459f-80bb-639b9429b963"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:10.829221 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] validate_networks() for [('8d96723e-3ac9-459f-80bb-639b9429b963', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 18:42:11.304911 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 18:42:11.305339 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 18:42:11.305817 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 18:42:11.306227 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 18:42:11.306749 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 18:42:11.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:11.315652 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:11.316453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:11.316894 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:11.333441 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 18:42:11.337889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Getting quotas for user d1934a2e2edb4b8a93baac501c9c5c3b and project 84f9c806f7d54963bd886eae2ab22c38. Resources: {'instances', 'ram', 'cores'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 18:42:11.395167 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 18:42:11.397875 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcf7dece-766c-4e40-8acd-fd2f4499e2dd',volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 18:42:11.523626 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2e4c7c83-0933-4b66-a0ee-254739b0c202 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.808118 May 09 18:42:11.524304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 508/1019] 10.222.0.25 () {60 vars in 1146 bytes} [Mon May 9 18:42:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 18:42:11.535624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a82573b6-b05a-4fc9-9dac-ee758bcc5c31 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:11.536357 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a82573b6-b05a-4fc9-9dac-ee758bcc5c31 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:11.595411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a82573b6-b05a-4fc9-9dac-ee758bcc5c31 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:11.601949 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a82573b6-b05a-4fc9-9dac-ee758bcc5c31 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1095 microversion: 2.1 time: 0.071461 May 09 18:42:11.602366 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 512/1020] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:11 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:12.619305 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:12.619990 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:12.628445 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:12.628975 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:12.629777 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:12.630365 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:12.725889 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:12.733134 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b2e67e09-5789-455f-bc5d-d0ced3afa995 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1211 microversion: 2.1 time: 0.119017 May 09 18:42:12.733710 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 509/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:12 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:13.750164 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:13.751859 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:13.759723 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:13.760604 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:13.761619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:13.762150 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:13.882214 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-668028e0-1e83-4e0f-a05e-638f2af7de0d req-5b6cb713-dd6e-4806-8fdf-8ef34f786c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbe76f5-4ae3-4d92-9126-5911dc61e633", "tag": "48905479-fcf2-443e-a46a-2cb9b96c827f"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:13.893678 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-668028e0-1e83-4e0f-a05e-638f2af7de0d req-5b6cb713-dd6e-4806-8fdf-8ef34f786c98 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:13.894491 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-668028e0-1e83-4e0f-a05e-638f2af7de0d req-5b6cb713-dd6e-4806-8fdf-8ef34f786c98 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:13.907813 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-668028e0-1e83-4e0f-a05e-638f2af7de0d req-5b6cb713-dd6e-4806-8fdf-8ef34f786c98 service nova] Creating event network-changed:48905479-fcf2-443e-a46a-2cb9b96c827f for instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 on hv-cinder-84112 May 09 18:42:13.920207 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-668028e0-1e83-4e0f-a05e-638f2af7de0d req-5b6cb713-dd6e-4806-8fdf-8ef34f786c98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042431 May 09 18:42:13.920973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 510/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:42:13.987990 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:13.996295 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ddcff32a-b277-460b-a6b4-063b43c3d47d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.250122 May 09 18:42:13.997141 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 513/1023] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:13 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:15.014407 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:15.015117 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:15.021453 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:15.021997 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:15.023342 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:15.023787 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:15.169651 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:15.177058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-db8a5e54-9f18-4f79-94d4-3bb2a77ff750 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.166988 May 09 18:42:15.177627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 511/1024] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:15 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:16.197555 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:16.197555 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:16.202451 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:16.202920 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:16.203751 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:16.204202 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:16.328444 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:16.336275 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d83fab2f-5caf-4b6c-8a86-5772147b3213 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.146183 May 09 18:42:16.336844 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 514/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:16 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:17.353484 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:17.354113 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:17.360661 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:17.361133 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:17.361912 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:17.362358 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:17.490220 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:17.498058 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1f15df9b-c6b0-4420-a6cf-f1b6befeafc8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.148975 May 09 18:42:17.498627 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 512/1026] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:17 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:18.514913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:18.515624 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:18.521567 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:18.522063 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:18.522831 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:18.523311 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:18.646523 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:18.654409 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f9d5db74-c0dc-4285-9d77-85bde835e681 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.143364 May 09 18:42:18.654969 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 515/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:18 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:19.671669 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:19.672304 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:19.678727 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:19.679213 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:19.680007 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:19.680460 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:19.809155 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:19.816442 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-52ac20e8-5290-464c-956a-0f94fb2c7115 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.148681 May 09 18:42:19.817010 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 513/1028] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:19 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:20.833600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:20.834220 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:20.840551 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:20.841049 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:20.841832 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:20.842280 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:20.966355 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:20.973688 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1fe5f2b5-acbc-47dd-84b5-c00c966daca5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.143985 May 09 18:42:20.974267 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 516/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:20 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:21.990888 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:21.991546 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:21.997838 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:21.998295 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:21.999061 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:21.999641 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:22.129251 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:22.137314 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-71d4acb8-eb2a-4f05-8c7f-486358228e74 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.150354 May 09 18:42:22.137887 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 514/1030] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:21 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:23.153633 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:23.154253 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:23.160547 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:23.161002 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:23.161782 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:23.162222 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:23.288075 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:23.295544 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a0823841-efe2-4f25-b94c-b3b106a14354 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.145760 May 09 18:42:23.296117 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 517/1031] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:23 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:24.312362 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:24.313017 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:24.319307 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.319771 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.320552 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.321039 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.452379 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:24.459607 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f6cb9183-2117-4098-8509-47bd179660bc tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.151042 May 09 18:42:24.460169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 515/1032] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:24 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:24.815093 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-10267e8e-c700-4f4e-a782-3a8487d3dd21 req-05234aa4-8fbc-4fe0-99c0-66989e5a68c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbe76f5-4ae3-4d92-9126-5911dc61e633", "name": "network-vif-plugged", "status": "completed", "tag": "48905479-fcf2-443e-a46a-2cb9b96c827f"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:24.822916 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-10267e8e-c700-4f4e-a782-3a8487d3dd21 req-05234aa4-8fbc-4fe0-99c0-66989e5a68c0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:24.823411 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-10267e8e-c700-4f4e-a782-3a8487d3dd21 req-05234aa4-8fbc-4fe0-99c0-66989e5a68c0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:24.834106 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-10267e8e-c700-4f4e-a782-3a8487d3dd21 req-05234aa4-8fbc-4fe0-99c0-66989e5a68c0 service nova] Creating event network-vif-plugged:48905479-fcf2-443e-a46a-2cb9b96c827f for instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 on hv-cinder-84112 May 09 18:42:24.839040 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-10267e8e-c700-4f4e-a782-3a8487d3dd21 req-05234aa4-8fbc-4fe0-99c0-66989e5a68c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147531 May 09 18:42:24.839658 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 518/1033] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:42:25.476282 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:25.476895 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:25.483164 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:25.483653 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:25.484427 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:25.484876 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:25.609988 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:25.617428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-78d6bf46-cfab-4a47-ad42-d027bd50d852 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1266 microversion: 2.1 time: 0.144937 May 09 18:42:25.617994 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 516/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:25 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:26.635412 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:26.636112 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:26.642171 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:26.642628 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:26.643435 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:26.643883 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:26.776619 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:26.783882 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a24ab563-9015-4f0a-9b77-c2eb616682cf tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1453 microversion: 2.1 time: 0.153211 May 09 18:42:26.784469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 519/1035] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:26 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:26.801027 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:42:26.801783 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:42:26.808356 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:26.808822 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:26.809601 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:26.810048 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:26.935136 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:42:26.942410 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bb56a78d-bd11-4e4b-8018-71895e595a2b tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1453 microversion: 2.1 time: 0.145267 May 09 18:42:26.942978 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 517/1036] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:42:26 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:42:28.511445 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-3e70f194-a5fc-48aa-8ae5-c2f4d5d46edb req-083d1d2f-30fd-492b-bb64-5aa3a76377d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbe76f5-4ae3-4d92-9126-5911dc61e633", "tag": "48905479-fcf2-443e-a46a-2cb9b96c827f"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:42:28.519613 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3e70f194-a5fc-48aa-8ae5-c2f4d5d46edb req-083d1d2f-30fd-492b-bb64-5aa3a76377d3 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:42:28.520064 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3e70f194-a5fc-48aa-8ae5-c2f4d5d46edb req-083d1d2f-30fd-492b-bb64-5aa3a76377d3 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:42:28.531733 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-3e70f194-a5fc-48aa-8ae5-c2f4d5d46edb req-083d1d2f-30fd-492b-bb64-5aa3a76377d3 service nova] Creating event network-changed:48905479-fcf2-443e-a46a-2cb9b96c827f for instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 on hv-cinder-84112 May 09 18:42:28.536914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-3e70f194-a5fc-48aa-8ae5-c2f4d5d46edb req-083d1d2f-30fd-492b-bb64-5aa3a76377d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029264 May 09 18:42:28.537600 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 520/1037] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:43:06.478148 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:43:06.478699 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Mon May 9 18:43:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:43:20.952309 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:43:20.952902 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Mon May 9 18:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:44:01.262797 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:01.263396 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:01.266296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-d60f039f-b92d-40e4-aab3-2bf74b8c0033 req-8d4448f7-a03e-4dfb-be73-c8b60179defb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbe76f5-4ae3-4d92-9126-5911dc61e633", "tag": "48905479-fcf2-443e-a46a-2cb9b96c827f"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:44:01.269389 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.269855 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.270643 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.271339 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.275228 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-d60f039f-b92d-40e4-aab3-2bf74b8c0033 req-8d4448f7-a03e-4dfb-be73-c8b60179defb service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.275940 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-d60f039f-b92d-40e4-aab3-2bf74b8c0033 req-8d4448f7-a03e-4dfb-be73-c8b60179defb service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.287167 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-d60f039f-b92d-40e4-aab3-2bf74b8c0033 req-8d4448f7-a03e-4dfb-be73-c8b60179defb service nova] Creating event network-changed:48905479-fcf2-443e-a46a-2cb9b96c827f for instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 on hv-cinder-84112 May 09 18:44:01.292549 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-d60f039f-b92d-40e4-aab3-2bf74b8c0033 req-8d4448f7-a03e-4dfb-be73-c8b60179defb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032729 May 09 18:44:01.293973 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 521/1038] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:44:01.297479 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:44:01.375088 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cce06306-815a-455e-a719-900ee08a1a64 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 204 len: 0 microversion: 2.1 time: 0.117799 May 09 18:44:01.376022 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 518/1039] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:44:01 2022] DELETE /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:44:01.384712 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:01.386009 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:01.391957 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.392425 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.393248 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:01.393695 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:01.523548 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:01.531077 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5cff79b3-9850-42be-a3a3-d1520e3e609d tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1577 microversion: 2.1 time: 0.150695 May 09 18:44:01.531722 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 522/1040] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:01 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:44:02.548599 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:02.549315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:02.555828 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:02.556284 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:02.557060 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:02.557509 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:02.753278 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:02.760616 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f0155245-9eec-4c37-b5a8-5295c8ffdce2 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1577 microversion: 2.1 time: 0.216224 May 09 18:44:02.761187 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 519/1041] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:02 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:03.590380 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-66f7b1ac-d87f-4a17-91b4-2611f2e2b284 req-a7420a7e-08e7-4185-b4d7-74d27f66c126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbe76f5-4ae3-4d92-9126-5911dc61e633", "name": "network-vif-deleted", "tag": "48905479-fcf2-443e-a46a-2cb9b96c827f"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:44:03.599498 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-66f7b1ac-d87f-4a17-91b4-2611f2e2b284 req-a7420a7e-08e7-4185-b4d7-74d27f66c126 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:03.599956 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-66f7b1ac-d87f-4a17-91b4-2611f2e2b284 req-a7420a7e-08e7-4185-b4d7-74d27f66c126 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:03.611094 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-66f7b1ac-d87f-4a17-91b4-2611f2e2b284 req-a7420a7e-08e7-4185-b4d7-74d27f66c126 service nova] Creating event network-vif-deleted:48905479-fcf2-443e-a46a-2cb9b96c827f for instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 on hv-cinder-84112 May 09 18:44:03.616767 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-66f7b1ac-d87f-4a17-91b4-2611f2e2b284 req-a7420a7e-08e7-4185-b4d7-74d27f66c126 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029997 May 09 18:44:03.617487 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 523/1042] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:44:03.778534 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:03.779086 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:03.785284 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:03.785741 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:03.786504 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:03.786945 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:03.846428 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:03.853835 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-643a55c4-8b6b-411e-94c4-502cff1940f1 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 200 len: 1226 microversion: 2.1 time: 0.079318 May 09 18:44:03.854637 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 520/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:03 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:44:04.872526 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:04.873234 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 5bbe76f5-4ae3-4d92-9126-5911dc61e633] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:04.879677 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:04.880136 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:04.880913 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:04.881361 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:04.894911 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] HTTP exception thrown: Instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 could not be found. May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Request method failure captured: May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 HTTP/1.1 May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV9GIpBHu9s_yeeZut2aMesYEHZrvuaGkHVfJX6Re2HIOC2JXx36TRty_H6NWzBT_gCya_N7s_jvBK01BNYmIWpG3A-ATaQ1WR6N2usEuSQ13uySK3CPi3B8F4U1uX13Z8NDrPFl13VNWpInMPN8ApFwu2hGYOFHtLqJjaKdXAmhtpE May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:44:04.896573 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_84f9c806f7d54963bd886eae2ab22c38"}]}] May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: d1934a2e2edb4b8a93baac501c9c5c3b May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 could not be found. May 09 18:44:04.898296 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '5bbe76f5-4ae3-4d92-9126-5911dc61e633'} May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 could not be found. May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:44:04.899469 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 could not be found. May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 could not be found. May 09 18:44:04.901059 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:04.902651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Returning 404 to user: Instance 5bbe76f5-4ae3-4d92-9126-5911dc61e633 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:44:04.902651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f32bf8e1-c087-4a52-9afa-65d290e19ea5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633" status: 404 len: 111 microversion: 2.1 time: 0.030663 May 09 18:44:04.902651 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 524/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:04 2022] GET /compute/v2.1/servers/5bbe76f5-4ae3-4d92-9126-5911dc61e633 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:44:07.942032 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-e98ea420-0321-4225-9383-e25613db690d req-012506bf-4907-48fd-9923-47ce41f9cfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a75af1-168a-42af-bf8e-d6686993ec57", "tag": "e62aae24-a129-4bd3-8fc6-1ca8a30531c5"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:44:07.949483 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:07.950004 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:07.950728 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e98ea420-0321-4225-9383-e25613db690d req-012506bf-4907-48fd-9923-47ce41f9cfb0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:07.951278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-e98ea420-0321-4225-9383-e25613db690d req-012506bf-4907-48fd-9923-47ce41f9cfb0 service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:07.959285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:07.959285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:07.959285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:07.959285 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:07.963629 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-e98ea420-0321-4225-9383-e25613db690d req-012506bf-4907-48fd-9923-47ce41f9cfb0 service nova] Creating event network-changed:e62aae24-a129-4bd3-8fc6-1ca8a30531c5 for instance b6a75af1-168a-42af-bf8e-d6686993ec57 on hv-cinder-84112 May 09 18:44:07.969066 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-e98ea420-0321-4225-9383-e25613db690d req-012506bf-4907-48fd-9923-47ce41f9cfb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030533 May 09 18:44:07.972682 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 525/1045] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 18:44:07.987616 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 18:44:08.065781 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7fa750ce-423e-4ee1-8416-67d0818161ba tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 204 len: 0 microversion: 2.1 time: 0.129287 May 09 18:44:08.069606 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 521/1046] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:44:07 2022] DELETE /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 18:44:08.075761 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:08.076762 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:08.083534 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:08.084249 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:08.085057 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:08.085516 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:08.249351 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:08.257431 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9bfb39aa-cd9c-418b-bdc3-020e4fd864f6 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1577 microversion: 2.1 time: 0.186327 May 09 18:44:08.258022 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 526/1047] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:08 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 18:44:09.276703 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:09.277951 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:09.284234 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:09.284696 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:09.285474 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:09.285921 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:09.448721 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:09.456649 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-620e471f-a00c-4ae0-b641-e3ddfe087157 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1577 microversion: 2.1 time: 0.184126 May 09 18:44:09.457236 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 522/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:09 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:10.208223 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-78cbc7be-44a0-46ab-9238-d856c5207825 req-4cbcea96-f513-44f8-88ae-0e25b014bb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a75af1-168a-42af-bf8e-d6686993ec57", "name": "network-vif-deleted", "tag": "e62aae24-a129-4bd3-8fc6-1ca8a30531c5"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 18:44:10.218134 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-78cbc7be-44a0-46ab-9238-d856c5207825 req-4cbcea96-f513-44f8-88ae-0e25b014bb7e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:10.218521 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-78cbc7be-44a0-46ab-9238-d856c5207825 req-4cbcea96-f513-44f8-88ae-0e25b014bb7e service nova] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:10.229847 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-78cbc7be-44a0-46ab-9238-d856c5207825 req-4cbcea96-f513-44f8-88ae-0e25b014bb7e service nova] Creating event network-vif-deleted:e62aae24-a129-4bd3-8fc6-1ca8a30531c5 for instance b6a75af1-168a-42af-bf8e-d6686993ec57 on hv-cinder-84112 May 09 18:44:10.235028 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-78cbc7be-44a0-46ab-9238-d856c5207825 req-4cbcea96-f513-44f8-88ae-0e25b014bb7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 May 09 18:44:10.235979 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 527/1049] 10.222.0.25 () {64 vars in 1317 bytes} [Mon May 9 18:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 18:44:10.473777 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:10.474955 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:10.481538 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:10.482008 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:10.483831 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:10.484294 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:10.555252 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1934a2e2edb4b8a93baac501c9c5c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9c806f7d54963bd886eae2ab22c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} May 09 18:44:10.563566 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-60989df2-521b-4c91-9942-a2ee1849d1c5 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 200 len: 1226 microversion: 2.1 time: 0.093551 May 09 18:44:10.564144 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 523/1050] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:10 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 18:44:10.663705 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:44:10.663869 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Mon May 9 18:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:44:11.582173 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:11.582889 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: b6a75af1-168a-42af-bf8e-d6686993ec57] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:11.588908 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:11.589377 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:11.590194 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:11.590657 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:11.607198 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] HTTP exception thrown: Instance b6a75af1-168a-42af-bf8e-d6686993ec57 could not be found. May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Request method failure captured: May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 HTTP/1.1 May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV9GIpBHu9s_yeeZut2aMesYEHZrvuaGkHVfJX6Re2HIOC2JXx36TRty_H6NWzBT_gCya_N7s_jvBK01BNYmIWpG3A-ATaQ1WR6N2usEuSQ13uySK3CPi3B8F4U1uX13Z8NDrPFl13VNWpInMPN8ApFwu2hGYOFHtLqJjaKdXAmhtpE May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:44:11.609540 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_84f9c806f7d54963bd886eae2ab22c38"}]}] May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: d1934a2e2edb4b8a93baac501c9c5c3b May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance b6a75af1-168a-42af-bf8e-d6686993ec57 could not be found. May 09 18:44:11.611200 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': 'b6a75af1-168a-42af-bf8e-d6686993ec57'} May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a75af1-168a-42af-bf8e-d6686993ec57 could not be found. May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:44:11.612369 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a75af1-168a-42af-bf8e-d6686993ec57 could not be found. May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a75af1-168a-42af-bf8e-d6686993ec57 could not be found. May 09 18:44:11.613914 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:11.615364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Returning 404 to user: Instance b6a75af1-168a-42af-bf8e-d6686993ec57 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:44:11.615364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8ba75d73-2278-42cb-94cf-c6c540641703 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57" status: 404 len: 111 microversion: 2.1 time: 0.033511 May 09 18:44:11.615364 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 528/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:11 2022] GET /compute/v2.1/servers/b6a75af1-168a-42af-bf8e-d6686993ec57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:44:12.291315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:12.291819 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:12.298640 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:12.299106 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:12.299926 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:12.300376 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:12.313524 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] HTTP exception thrown: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Request method failure captured: May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: request: DELETE /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 HTTP/1.1 May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept: application/json May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Accept-Encoding: identity May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Connection: close May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Length: 0 May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Content-Type: application/json May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Host: 10.222.0.25 May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Openstack-System-Scope: None May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: User-Agent: python-urllib3/1.26.9 May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Auth-Token: gAAAAABieV9GIpBHu9s_yeeZut2aMesYEHZrvuaGkHVfJX6Re2HIOC2JXx36TRty_H6NWzBT_gCya_N7s_jvBK01BNYmIWpG3A-ATaQ1WR6N2usEuSQ13uySK3CPi3B8F4U1uX13Z8NDrPFl13VNWpInMPN8ApFwu2hGYOFHtLqJjaKdXAmhtpE May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Id: None May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Domain-Name: None May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Identity-Status: Confirmed May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Is-Admin-Project: True May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Id: default May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Domain-Name: Default May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Project-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Role: reader,member May 09 18:44:12.315169 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Roles: reader,member May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_84f9c806f7d54963bd886eae2ab22c38"}]}] May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-Tenant-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Id: default May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Domain-Name: Default May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Id: d1934a2e2edb4b8a93baac501c9c5c3b May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: X-User-Name: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: method: > May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: exception: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.316793 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: action_args: {'id': '1ac89178-8a4d-4e19-949a-c5972218cb08'} May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:44:12.317662 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.318973 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: ERROR nova.api.openstack.wsgi May 09 18:44:12.320315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Returning 404 to user: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:44:12.320315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5737b154-5ba5-4cd4-80a0-95859495f773 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 404 len: 111 microversion: 2.1 time: 0.029251 May 09 18:44:12.320315 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 524/1052] 10.222.0.25 () {58 vars in 1238 bytes} [Mon May 9 18:44:12 2022] DELETE /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 18:44:12.325201 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:12.325828 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] [instance: 1ac89178-8a4d-4e19-949a-c5972218cb08] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 18:44:12.331702 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:12.332162 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:12.332942 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 18:44:12.333388 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Lock "6582a570-2abd-4bbd-b400-f90edc06f4a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 18:44:12.348802 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] HTTP exception thrown: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Request method failure captured: May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: request: GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 HTTP/1.1 May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept: application/json May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Accept-Encoding: identity May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Connection: close May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Length: 0 May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Content-Type: application/json May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Host: 10.222.0.25 May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Openstack-System-Scope: None May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: User-Agent: python-urllib3/1.26.9 May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Auth-Token: gAAAAABieV9GIpBHu9s_yeeZut2aMesYEHZrvuaGkHVfJX6Re2HIOC2JXx36TRty_H6NWzBT_gCya_N7s_jvBK01BNYmIWpG3A-ATaQ1WR6N2usEuSQ13uySK3CPi3B8F4U1uX13Z8NDrPFl13VNWpInMPN8ApFwu2hGYOFHtLqJjaKdXAmhtpE May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Id: None May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Domain-Name: None May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Identity-Status: Confirmed May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Is-Admin-Project: True May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Id: default May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Domain-Name: Default May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Project-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Role: reader,member May 09 18:44:12.350307 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Roles: reader,member May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/84f9c806f7d54963bd886eae2ab22c38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_84f9c806f7d54963bd886eae2ab22c38"}]}] May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Id: 84f9c806f7d54963bd886eae2ab22c38 May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-Tenant-Name: tempest-TestVolumeBootPattern-1956176469 May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Id: default May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Domain-Name: Default May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Id: d1934a2e2edb4b8a93baac501c9c5c3b May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: X-User-Name: tempest-TestVolumeBootPattern-1956176469-project May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: method: > May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: exception: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.352221 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: action_args: {'id': '1ac89178-8a4d-4e19-949a-c5972218cb08'} May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 18:44:12.353033 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. May 09 18:44:12.354303 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: ERROR nova.api.openstack.wsgi May 09 18:44:12.356018 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Returning 404 to user: Instance 1ac89178-8a4d-4e19-949a-c5972218cb08 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 18:44:12.356018 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-371b9af5-7ac2-411f-9b8c-9a96da810fa3 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08" status: 404 len: 111 microversion: 2.1 time: 0.030421 May 09 18:44:12.356018 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 529/1053] 10.222.0.25 () {58 vars in 1235 bytes} [Mon May 9 18:44:12 2022] GET /compute/v2.1/servers/1ac89178-8a4d-4e19-949a-c5972218cb08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 18:44:13.627608 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-330b531c-a995-4131-a008-e6a8c8f334e8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] Calling method '.version_select at 0x7f3f7e631280>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 18:44:13.662731 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-330b531c-a995-4131-a008-e6a8c8f334e8 tempest-TestVolumeBootPattern-1956176469 tempest-TestVolumeBootPattern-1956176469-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2017172084" status: 202 len: 0 microversion: 2.1 time: 0.038681 May 09 18:44:13.663354 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 525/1054] 10.222.0.25 () {58 vars in 1262 bytes} [Mon May 9 18:44:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2017172084 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 18:44:39.750139 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:44:39.750851 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Mon May 9 18:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:46:40.960620 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:46:40.961243 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Mon May 9 18:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:46:53.051267 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:46:53.051834 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Mon May 9 18:46:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:47:30.672278 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:47:30.672928 dv-cinder-841125-3-iscsi devstack@n-api.service[117087]: Mon May 9 18:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 18:47:59.758107 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 18:47:59.758707 dv-cinder-841125-3-iscsi devstack@n-api.service[117088]: Mon May 9 18:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!